Sep 18 11:16:39 devstack cinder-volume[75405]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75405) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 18 11:16:39 devstack cinder-volume[75405]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75405) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 18 11:16:39 devstack cinder-volume[75405]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75405) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 18 11:16:41 devstack cinder-volume[75405]: INFO dbcounter [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Registered counter for database cinder Sep 18 11:16:41 devstack cinder-volume[75405]: DEBUG oslo_db.sqlalchemy.engines [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75405) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:16:41 devstack cinder-volume[75405]: DEBUG dbcounter [-] [75405] Writer thread running {{(pid=75405) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 18 11:16:41 devstack cinder-volume[75405]: INFO cinder.rpc [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 11:16:41 devstack cinder-volume[75405]: INFO cinder.rpc [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 11:16:41 devstack cinder-volume[75405]: DEBUG oslo_db.sqlalchemy.engines [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75405) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:16:41 devstack cinder-volume[75405]: INFO cinder.volume.manager [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Determined volume DB was empty at startup. Sep 18 11:16:41 devstack cinder-volume[75405]: DEBUG cinder.volume.manager [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75405) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 18 11:16:41 devstack cinder-volume[75405]: INFO cinder.volume.manager [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 18 11:16:41 devstack cinder-volume[75405]: WARNING stevedore.named [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 11:16:41 devstack cinder-volume[75405]: WARNING castellan.key_manager [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 11:16:41 devstack cinder-volume[75405]: WARNING cinder.keymgr.conf_key_mgr [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 11:16:42 devstack cinder-volume[75405]: DEBUG cinder.volume.drivers.lvm [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75405) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 18 11:16:42 devstack cinder-volume[75405]: DEBUG oslo_concurrency.processutils [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75405) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:43 devstack cinder-volume[75405]: DEBUG oslo_concurrency.processutils [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] CMD "cinder-rtstool verify" returned: 0 in 1.692s {{(pid=75405) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_db.sqlalchemy.engines [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75405) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:16:44 devstack cinder-volume[75405]: INFO cinder.rpc [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 18 11:16:44 devstack cinder-volume[75405]: INFO cinder.rpc [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 18 11:16:44 devstack cinder-volume[75405]: WARNING stevedore.named [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 11:16:44 devstack cinder-volume[75405]: WARNING castellan.key_manager [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 11:16:44 devstack cinder-volume[75405]: INFO cinder.volume.manager [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_db.sqlalchemy.engines [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75405) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:16:44 devstack cinder-volume[75405]: INFO oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Starting 1 workers Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Started child 75573 {{(pid=75405) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Full set of CONF: {{(pid=75405) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] ******************************************************************************** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Configuration options gathered from: {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] ================================================================================ {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] allow_availability_zone_fallback = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] allow_compression_on_image_upload = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] allowed_direct_url_schemes = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] api_rate_limit = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] auth_strategy = keystone {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] az_cache_duration = 3600 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_availability_zone = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_host = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_stats_polling_interval = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backup_api_class = cinder.backup.api.API {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backup_name_template = backup-%s {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backup_use_same_host = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backup_use_temp_snapshot = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] chap_password = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] chap_username = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_internal_tenant_project_id = af8cbabc735f4240bc346c67c0046ed4 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_internal_tenant_user_id = dec436cfaf514ebbaa662ae762cb24fc {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cloned_volume_same_az = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cluster = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] compression_format = gzip {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] compute_api_class = cinder.compute.nova.API {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] config_dir = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] config_source = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] control_exchange = openstack {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75573]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0) Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] debug = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] default_availability_zone = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] default_group_type = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] default_volume_type = lvmdriver-1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] driver_client_cert = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] driver_client_cert_key = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] driver_data_namespace = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] driver_ssl_cert_path = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] driver_ssl_cert_verify = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] driver_use_ssl = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] enable_force_upload = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] enable_new_services = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] enable_unsupported_driver = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] enforce_multipath_for_image_xfer = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] filter_function = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_api_insecure = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_api_servers = ['http://192.168.122.143/image'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_api_ssl_compression = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_ca_certificates_file = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_catalog_info = image:glance:publicURL {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_certfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_keyfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_num_retries = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance_request_timeout = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] goodness_function = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] graceful_shutdown_timeout = 5 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] group_api_class = cinder.group.api.API {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] host = devstack {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_compress_on_upload = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_conversion_address_space_limit = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_conversion_cpu_limit = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_conversion_disable = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_upload_use_cinder_backend = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_upload_use_internal_tenant = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_volume_cache_enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_volume_cache_max_count = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] init_host_max_objects_retrieval = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] instance_format = [instance: %(uuid)s] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] iscsi_iotype = fileio {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] iscsi_target_flags = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] iscsi_write_cache = on {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] iser_helper = tgtadm {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] iser_ip_address = 192.168.122.143 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] iser_port = 3260 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_color = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_config_append = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_dir = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_file = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_options = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_rotate_interval = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_rotate_interval_type = days {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] log_rotation_type = none {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] max_age = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] max_logfile_count = 30 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] max_logfile_size_mb = 200 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] max_over_subscription_ratio = 20.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] message_reap_interval = 86400 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] message_ttl = 2592000 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] monkey_patch = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] monkey_patch_modules = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] my_ip = 192.168.122.143 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] no_snapshot_gb_quota = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] num_iser_scan_tries = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] num_shell_tries = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] num_volume_device_scan_tries = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] nvmeof_conn_info_version = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] nvmet_ns_id = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] nvmet_port_id = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] osapi_max_limit = 1000 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] osapi_volume_ext_list = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] osapi_volume_listen_port = 8776 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] osapi_volume_use_ssl = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] osapi_volume_workers = 2 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] per_volume_size_limit = -1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] periodic_fuzzy_delay = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] periodic_interval = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] public_endpoint = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] publish_errors = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] quota_backup_gigabytes = 1000 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] quota_backups = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] quota_gigabytes = 1000 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] quota_groups = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] quota_snapshots = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] quota_volumes = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] rate_limit_burst = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] rate_limit_except_level = CRITICAL {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] rate_limit_interval = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] reinit_driver_count = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] replication_device = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] report_discard_supported = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] report_interval = 120 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] reservation_clean_interval = 86400 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] reservation_expire = 86400 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] reserved_image_namespaces = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] reserved_percentage = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] rpc_response_timeout = 120 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] run_external_periodic_tasks = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] scst_target_driver = iscsi {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] scst_target_iqn_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_down_time = 720 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] shell_completion = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] snapshot_name_template = snapshot-%s {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] snapshot_same_host = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] split_loggers = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] state_path = /opt/stack/data/cinder {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] storage_availability_zone = nova {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] storage_protocol = iSCSI {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] syslog_log_facility = LOG_USER {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] target_helper = lioadm {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] target_ip_address = 192.168.122.143 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] target_port = 3260 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] target_protocol = iscsi {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] target_secondary_ip_addresses = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] trace_flags = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] transport_url = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] until_refresh = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] use_chap_auth = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] use_default_quota_class = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] use_journal = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] use_json = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] use_multipath_for_image_xfer = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] use_stderr = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] use_syslog = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] verify_glance_signatures = enabled {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_api_class = cinder.volume.api.API {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_backend_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_clear = zero {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_clear_ionice = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_clear_size = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_copy_bps_limit = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_dd_blocksize = 1M {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_name_template = volume-%s {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_service_inithost_offload = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volume_usage_audit_period = month {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] watch_log_file = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] zoning_mode = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.admin_password = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.admin_token = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.admin_user = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.auth_port = 35357 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.auth_protocol = https {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.auth_section = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.auth_type = password {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.auth_uri = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.auth_version = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.cache = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.certfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.identity_uri = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.insecure = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.interface = public {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.keyfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_password = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcache_username = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.region_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.service_type = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.backend = dogpile.cache.null {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.backend_argument = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.backend_expiration_time = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.config_prefix = cache.oslo {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.dead_timeout = 60.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.debug_cache_backend = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.enable_retry_client = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.enable_socket_keepalive = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.enforce_fips_mode = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.expiration_time = 600 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.hashclient_retry_delay = 1.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_dead_retry = 300 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_password = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_pool_maxsize = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_sasl_enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_socket_timeout = 1.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.memcache_username = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.proxies = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.redis_db = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.redis_password = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.redis_server = localhost:6379 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.redis_socket_timeout = 1.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.redis_username = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.retry_attempts = 2 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.retry_delay = 0.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.socket_keepalive_count = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.socket_keepalive_idle = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.socket_keepalive_interval = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.tls_allowed_ciphers = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.tls_cafile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.tls_certfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.tls_enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cache.tls_keyfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] coordination.backend_url = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.asyncio_connection = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.asyncio_slave_connection = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.backend = sqlalchemy {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.connection = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.connection_debug = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.connection_parameters = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.connection_recycle_time = 3600 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.connection_trace = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.db_inc_retry_interval = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.db_max_retries = 20 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.db_max_retry_interval = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.db_retry_interval = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.max_overflow = 50 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.max_pool_size = 5 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.max_retries = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.pool_timeout = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.retry_interval = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.slave_connection = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.sqlite_synchronous = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] database.use_db_reconnect = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.connection_string = messaging:// {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.es_doc_type = notification {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.es_scroll_size = 10000 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.es_scroll_time = 2m {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.filter_error_trace = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.hmac_keys = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.sentinel_service_name = mymaster {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.socket_timeout = 0.1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.trace_requests = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler.trace_sqlalchemy = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler_jaeger.process_tags = {} {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] profiler_otlp.service_name_prefix = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.enforce_new_defaults = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: WARNING oslo_config.cfg [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.enforce_scope = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.policy_default_rule = default {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.policy_file = policy.yaml {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] privsep_osbrick.group = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] privsep_osbrick.helper_command = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] privsep_osbrick.user = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_sys_admin.group = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_sys_admin.helper_command = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] cinder_sys_admin.user = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.auth_section = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.auth_type = password {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.certfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.collect_timing = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.insecure = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.keyfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.send_service_user_token = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.split_loggers = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] service_user.timeout = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.auth_section = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.auth_type = password {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.certfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.collect_timing = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.insecure = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.keyfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.split_loggers = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] glance.timeout = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.backend_availability_zone = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.chap_password = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.chap_username = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.driver_client_cert = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.driver_data_namespace = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.driver_use_ssl = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.extra_capabilities = {} {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.filter_function = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.goodness_function = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.iscsi_iotype = fileio {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.iscsi_target_flags = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.iser_helper = tgtadm {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.iser_ip_address = 192.168.122.143 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.iser_port = 3260 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.lvm_share_target = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.lvm_type = auto {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.replication_device = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.report_discard_supported = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.target_helper = tgtadm {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.target_ip_address = 192.168.122.143 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.target_port = 3260 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.target_protocol = iscsi {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.trace_flags = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:44 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.use_chap_auth = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_backend_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_clear = zero {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75573]: INFO cinder.volume.manager [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_reports.file_event_handler = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_reports.log_dir = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.backend_host = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.chap_password = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.chap_username = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.filter_function = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.goodness_function = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.iscsi_iotype = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.iser_helper = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.iser_ip_address = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.iser_port = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.lvm_share_target = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.lvm_type = auto {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.num_shell_tries = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.replication_device = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.storage_protocol = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.target_helper = lioadm {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.target_ip_address = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.target_port = 3260 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.trace_flags = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.use_chap_auth = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_clear = zero {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_clear_size = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] lvmdriver-1.volumes_dir = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.ssl = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_notifications.driver = [] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] key_manager.fixed_key = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.barbican_api_version = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.barbican_endpoint = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.barbican_endpoint_type = public {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.barbican_region_name = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.cafile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.certfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.collect_timing = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.insecure = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.keyfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.number_of_retries = 60 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.retry_delay = 1 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.send_service_user_token = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.split_loggers = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.timeout = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.verify_ssl = True {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican.verify_ssl_path = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.auth_section = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.auth_type = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.cafile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.certfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.collect_timing = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.insecure = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.keyfile = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.split_loggers = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] barbican_service_user.timeout = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.approle_role_id = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.approle_secret_id = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.kv_mountpoint = secret {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.kv_path = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.kv_version = 2 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.namespace = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.root_token_id = **** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.ssl_ca_crt_file = None {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.timeout = 60.0 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.use_ssl = False {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:16:45 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] ******************************************************************************** {{(pid=75405) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 18 11:16:45 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.172s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:45 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:45 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.096s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:45 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:45 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.092s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:45 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:45 devstack sudo[75627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 18 11:16:45 devstack sudo[75627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:16:47 devstack sudo[75627]: pam_unix(sudo:session): session closed for user root Sep 18 11:16:47 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.108s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:47 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:47 devstack sudo[75754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:16:47 devstack sudo[75754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:16:49 devstack sudo[75754]: pam_unix(sudo:session): session closed for user root Sep 18 11:16:49 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.023s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:49 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:16:49 devstack cinder-volume[75573]: INFO cinder.brick.local_dev.lvm [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 18 11:16:49 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:49 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.093s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:49 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:49 devstack sudo[75848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:16:49 devstack sudo[75848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:16:52 devstack sudo[75848]: pam_unix(sudo:session): session closed for user root Sep 18 11:16:52 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.433s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:52 devstack cinder-volume[75573]: DEBUG cinder.brick.local_dev.lvm [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75573) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 18 11:16:52 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:52 devstack sudo[75962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:16:52 devstack sudo[75962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:16:54 devstack cinder-volume[75405]: DEBUG dbcounter [-] [75405] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75405) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:16:56 devstack sudo[75962]: pam_unix(sudo:session): session closed for user root Sep 18 11:16:56 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.982s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:56 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:56 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.076s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:56 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:56 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:16:56 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:16:58 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Sep 18 11:16:58 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.021s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:58 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:58 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.080s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:16:58 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:16:58 devstack sudo[76181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 18 11:16:58 devstack sudo[76181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:01 devstack sudo[76181]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.636s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:01 devstack sudo[76246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:17:01 devstack sudo[76246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:03 devstack sudo[76246]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.705s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:04 devstack sudo[76276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:17:04 devstack sudo[76276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:06 devstack sudo[76276]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:06 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.827s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:06 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:06 devstack sudo[76281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:17:06 devstack sudo[76281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:09 devstack sudo[76281]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:09 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.677s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:09 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:09 devstack sudo[76286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:17:09 devstack sudo[76286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:11 devstack sudo[76286]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:11 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.215s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:11 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:11 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.131s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:11 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:12 devstack sudo[76295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:17:12 devstack sudo[76295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:14 devstack sudo[76295]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:14 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.364s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:14 devstack cinder-volume[75573]: INFO cinder.volume.drivers.lvm [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 18 11:17:14 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:14 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:14 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:14 devstack sudo[76410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:17:14 devstack sudo[76410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:16 devstack sudo[76410]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:16 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.965s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:16 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:17:16 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:16 devstack sudo[76476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:17:16 devstack sudo[76476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:18 devstack sudo[76476]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:18 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.167s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:18 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:18 devstack sudo[76553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:17:18 devstack sudo[76553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:20 devstack sudo[76553]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:20 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.199s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:20 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:20 devstack sudo[76556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:17:20 devstack sudo[76556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:23 devstack sudo[76556]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:23 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.308s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:23 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:23 devstack sudo[76562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:17:23 devstack sudo[76562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:25 devstack sudo[76562]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:25 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.992s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:25 devstack cinder-volume[75573]: INFO cinder.volume.driver [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Driver hasn't implemented _init_vendor_properties() Sep 18 11:17:25 devstack cinder-volume[75573]: DEBUG cinder.volume.driver [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75573) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 18 11:17:25 devstack cinder-volume[75573]: DEBUG oslo_db.sqlalchemy.engines [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:17:25 devstack cinder-volume[75573]: DEBUG dbcounter [-] [75573] Writer thread running {{(pid=75573) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 18 11:17:25 devstack cinder-volume[75573]: DEBUG cinder.db.sqlalchemy.api [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Building query based on filter {{(pid=75573) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 18 11:17:25 devstack cinder-volume[75573]: DEBUG cinder.image.image_utils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75573) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 18 11:17:25 devstack cinder-volume[75573]: INFO cinder.keymgr.migration [None req-dd5efaa5-4ec4-4c0e-8c51-871ecfa90e19 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 11:17:25 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:17:25 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:25 devstack sudo[76568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:17:25 devstack sudo[76568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:27 devstack sudo[76568]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:27 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.013s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:27 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:27 devstack sudo[76597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:17:27 devstack sudo[76597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:29 devstack sudo[76597]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:29 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.102s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:29 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:29 devstack sudo[76709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:17:29 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:32 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:32 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.513s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:32 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:32 devstack sudo[76719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:17:32 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:34 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:34 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.983s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:34 devstack cinder-volume[75573]: DEBUG cinder.manager [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Notifying Schedulers of capabilities ... {{(pid=75573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:17:34 devstack cinder-volume[75573]: INFO cinder.volume.manager [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Driver initialization completed successfully. Sep 18 11:17:34 devstack cinder-volume[75573]: INFO cinder.manager [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Initiating service 2 cleanup Sep 18 11:17:34 devstack cinder-volume[75573]: INFO cinder.manager [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Service 2 cleanup completed. Sep 18 11:17:34 devstack cinder-volume[75573]: DEBUG cinder.service [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Creating RPC server for service cinder-volume {{(pid=75573) start /opt/stack/cinder/cinder/service.py:239}} Sep 18 11:17:34 devstack cinder-volume[75573]: DEBUG cinder.service [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75573) start /opt/stack/cinder/cinder/service.py:245}} Sep 18 11:17:34 devstack cinder-volume[75573]: INFO cinder.volume.manager [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 18 11:17:34 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:17:34 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:34 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:17:34 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:36 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:36 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.895s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:36 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:36 devstack sudo[76730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:17:36 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:38 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:38 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.033s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:38 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:38 devstack sudo[76733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:17:38 devstack sudo[76733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:40 devstack sudo[76733]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:40 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.967s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:40 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:17:40 devstack sudo[76740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:17:40 devstack sudo[76740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:17:42 devstack sudo[76740]: pam_unix(sudo:session): session closed for user root Sep 18 11:17:42 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.928s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:17:42 devstack cinder-volume[75573]: DEBUG dbcounter [-] [75573] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75573) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:17:42 devstack cinder-volume[75573]: INFO cinder.volume.manager [None req-daa70a11-f4a9-4ae4-b8cb-3956620c90d9 None None] Driver post RPC initialization completed successfully. Sep 18 11:17:52 devstack cinder-volume[75573]: DEBUG dbcounter [-] [75573] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75573) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:17:59 devstack cinder-volume[75573]: DEBUG oslo_service.periodic_task [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75573) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:17:59 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:17:59 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:18:00 devstack sudo[77281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:18:00 devstack sudo[77281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:18:01 devstack sudo[77281]: pam_unix(sudo:session): session closed for user root Sep 18 11:18:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.935s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:18:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:18:01 devstack sudo[77357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:18:01 devstack sudo[77357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:18:03 devstack sudo[77357]: pam_unix(sudo:session): session closed for user root Sep 18 11:18:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.925s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:18:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:18:03 devstack sudo[77366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:18:03 devstack sudo[77366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:18:05 devstack sudo[77366]: pam_unix(sudo:session): session closed for user root Sep 18 11:18:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.956s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:18:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:18:05 devstack sudo[77369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:18:05 devstack sudo[77369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:18:07 devstack sudo[77369]: pam_unix(sudo:session): session closed for user root Sep 18 11:18:07 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.911s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:18:07 devstack cinder-volume[75573]: DEBUG cinder.manager [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Notifying Schedulers of capabilities ... {{(pid=75573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:18:59 devstack cinder-volume[75573]: DEBUG oslo_service.periodic_task [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75573) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:18:59 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:18:59 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:19:00 devstack sudo[78172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:19:00 devstack sudo[78172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:19:01 devstack sudo[78172]: pam_unix(sudo:session): session closed for user root Sep 18 11:19:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.933s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:19:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:19:01 devstack sudo[78176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:19:01 devstack sudo[78176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:19:03 devstack sudo[78176]: pam_unix(sudo:session): session closed for user root Sep 18 11:19:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.965s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:19:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:19:03 devstack sudo[78182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:19:03 devstack sudo[78182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:19:05 devstack sudo[78182]: pam_unix(sudo:session): session closed for user root Sep 18 11:19:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.890s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:19:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:19:05 devstack sudo[78197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:19:05 devstack sudo[78197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:19:07 devstack sudo[78197]: pam_unix(sudo:session): session closed for user root Sep 18 11:19:07 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.747s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:19:07 devstack cinder-volume[75573]: DEBUG cinder.manager [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Notifying Schedulers of capabilities ... {{(pid=75573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:19:53 devstack cinder-volume[75573]: DEBUG dbcounter [-] [75573] Writing DB stats cinder:SELECT=1 {{(pid=75573) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:19:53 devstack cinder-volume[75573]: DEBUG dbcounter [-] [75573] Writing DB stats cinder:UPDATE=1 {{(pid=75573) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:19:59 devstack cinder-volume[75573]: DEBUG oslo_service.periodic_task [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75573) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:19:59 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:19:59 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:20:00 devstack sudo[79120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:20:00 devstack sudo[79120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:20:01 devstack sudo[79120]: pam_unix(sudo:session): session closed for user root Sep 18 11:20:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.032s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:20:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:20:02 devstack sudo[79151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:20:02 devstack sudo[79151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:20:03 devstack sudo[79151]: pam_unix(sudo:session): session closed for user root Sep 18 11:20:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.986s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:20:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:20:04 devstack sudo[79155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:20:04 devstack sudo[79155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:20:05 devstack sudo[79155]: pam_unix(sudo:session): session closed for user root Sep 18 11:20:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.934s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:20:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:20:06 devstack sudo[79160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:20:06 devstack sudo[79160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:20:07 devstack sudo[79160]: pam_unix(sudo:session): session closed for user root Sep 18 11:20:07 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.918s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:20:07 devstack cinder-volume[75573]: DEBUG cinder.manager [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Notifying Schedulers of capabilities ... {{(pid=75573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:20:59 devstack cinder-volume[75573]: DEBUG oslo_service.periodic_task [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75573) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:20:59 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:20:59 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:21:00 devstack sudo[81681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:21:00 devstack sudo[81681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:21:01 devstack sudo[81681]: pam_unix(sudo:session): session closed for user root Sep 18 11:21:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.834s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:21:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:21:01 devstack sudo[81684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:21:01 devstack sudo[81684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:21:03 devstack sudo[81684]: pam_unix(sudo:session): session closed for user root Sep 18 11:21:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.774s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:21:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:21:03 devstack sudo[81688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:21:03 devstack sudo[81688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:21:05 devstack sudo[81688]: pam_unix(sudo:session): session closed for user root Sep 18 11:21:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.834s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:21:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:21:05 devstack sudo[81693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:21:05 devstack sudo[81693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:21:07 devstack sudo[81693]: pam_unix(sudo:session): session closed for user root Sep 18 11:21:07 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.964s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:21:07 devstack cinder-volume[75573]: DEBUG cinder.manager [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Notifying Schedulers of capabilities ... {{(pid=75573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:21:53 devstack cinder-volume[75573]: DEBUG dbcounter [-] [75573] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75573) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:21:59 devstack cinder-volume[75573]: DEBUG oslo_service.periodic_task [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75573) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:21:59 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:21:59 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:22:00 devstack sudo[81983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:22:00 devstack sudo[81983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:22:01 devstack sudo[81983]: pam_unix(sudo:session): session closed for user root Sep 18 11:22:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.850s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:22:01 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:22:01 devstack sudo[81986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:22:01 devstack sudo[81986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:22:03 devstack sudo[81986]: pam_unix(sudo:session): session closed for user root Sep 18 11:22:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.801s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:22:03 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:22:03 devstack sudo[81993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:22:03 devstack sudo[81993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:22:05 devstack sudo[81993]: pam_unix(sudo:session): session closed for user root Sep 18 11:22:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.828s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:22:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:22:05 devstack sudo[81998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:22:05 devstack sudo[81998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:22:07 devstack sudo[81998]: pam_unix(sudo:session): session closed for user root Sep 18 11:22:07 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.751s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:22:07 devstack cinder-volume[75573]: DEBUG cinder.manager [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Notifying Schedulers of capabilities ... {{(pid=75573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:22:59 devstack cinder-volume[75573]: DEBUG oslo_service.periodic_task [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75573) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:22:59 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Updating volume stats {{(pid=75573) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 18 11:22:59 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:00 devstack sudo[82670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 11:23:00 devstack sudo[82670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:23:02 devstack sudo[82670]: pam_unix(sudo:session): session closed for user root Sep 18 11:23:02 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.725s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:02 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:02 devstack sudo[82704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:23:02 devstack sudo[82704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:23:05 devstack sudo[82704]: pam_unix(sudo:session): session closed for user root Sep 18 11:23:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.639s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:05 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:05 devstack sudo[82737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 11:23:05 devstack sudo[82737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:23:07 devstack sudo[82737]: pam_unix(sudo:session): session closed for user root Sep 18 11:23:07 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.079s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:07 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:07 devstack sudo[82769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 11:23:07 devstack sudo[82769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:23:10 devstack sudo[82769]: pam_unix(sudo:session): session closed for user root Sep 18 11:23:10 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.724s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:10 devstack cinder-volume[75573]: DEBUG cinder.manager [None req-0083a920-9cb4-4af5-88b2-8fb60fde192e None None] Notifying Schedulers of capabilities ... {{(pid=75573) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:23:16 devstack cinder-volume[75405]: INFO oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Caught SIGTERM, stopping children Sep 18 11:23:16 devstack cinder-volume[75405]: DEBUG oslo_concurrency.lockutils [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Acquiring lock "singleton_lock" {{(pid=75405) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 18 11:23:16 devstack cinder-volume[75405]: DEBUG oslo_concurrency.lockutils [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Acquired lock "singleton_lock" {{(pid=75405) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 18 11:23:16 devstack cinder-volume[75405]: DEBUG oslo_concurrency.lockutils [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Releasing lock "singleton_lock" {{(pid=75405) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 18 11:23:16 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Stop services. {{(pid=75405) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 18 11:23:16 devstack cinder-volume[75405]: DEBUG oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Killing children. {{(pid=75405) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 18 11:23:16 devstack cinder-volume[75405]: INFO oslo_service.backend._eventlet.service [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Waiting on 1 children to exit Sep 18 11:23:21 devstack cinder-volume[75573]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 18 11:23:24 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Acquiring lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 18 11:23:24 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Acquired lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 18 11:23:24 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Releasing lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 18 11:23:24 devstack cinder-volume[75573]: WARNING amqp [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 11:23:24 devstack cinder-volume[75573]: WARNING amqp [None req-9843a95c-3dbe-46fa-8468-33aa494e6ef0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 11:23:38 devstack cinder-volume[82979]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82979) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 18 11:23:38 devstack cinder-volume[82979]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82979) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 18 11:23:38 devstack cinder-volume[82979]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82979) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 18 11:23:41 devstack cinder-volume[82979]: INFO dbcounter [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Registered counter for database cinder Sep 18 11:23:41 devstack cinder-volume[82979]: DEBUG oslo_db.sqlalchemy.engines [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG dbcounter [-] [82979] Writer thread running {{(pid=82979) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 18 11:23:42 devstack cinder-volume[82979]: INFO cinder.rpc [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 11:23:42 devstack cinder-volume[82979]: INFO cinder.rpc [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_db.sqlalchemy.engines [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:23:42 devstack cinder-volume[82979]: INFO cinder.volume.manager [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Determined volume DB was empty at startup. Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG cinder.volume.manager [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82979) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 18 11:23:42 devstack cinder-volume[82979]: INFO cinder.volume.manager [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 18 11:23:42 devstack cinder-volume[82979]: WARNING stevedore.named [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 11:23:42 devstack cinder-volume[82979]: WARNING castellan.key_manager [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 11:23:42 devstack cinder-volume[82979]: WARNING cinder.keymgr.conf_key_mgr [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 11:23:42 devstack cinder-volume[82979]: INFO cinder.volume.manager [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_db.sqlalchemy.engines [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:23:42 devstack cinder-volume[82979]: INFO oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Starting 1 workers Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Started child 83184 {{(pid=82979) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Full set of CONF: {{(pid=82979) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] ******************************************************************************** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Configuration options gathered from: {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] ================================================================================ {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] allow_availability_zone_fallback = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] allow_compression_on_image_upload = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] allowed_direct_url_schemes = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] api_rate_limit = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] auth_strategy = keystone {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_availability_zone = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_host = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_stats_polling_interval = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backup_api_class = cinder.backup.api.API {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backup_name_template = backup-%s {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backup_use_same_host = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backup_use_temp_snapshot = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] chap_password = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] chap_username = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_internal_tenant_project_id = af8cbabc735f4240bc346c67c0046ed4 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_internal_tenant_user_id = dec436cfaf514ebbaa662ae762cb24fc {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cluster = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] compression_format = gzip {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] compute_api_class = cinder.compute.nova.API {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] config_dir = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] config_source = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] control_exchange = openstack {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] debug = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] default_availability_zone = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] default_group_type = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] default_volume_type = QuobyteHD {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[83184]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0) Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] driver_client_cert = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] driver_client_cert_key = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] driver_data_namespace = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] driver_ssl_cert_path = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] driver_ssl_cert_verify = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] driver_use_ssl = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] enable_new_services = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] enable_unsupported_driver = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] enabled_backends = ['QuobyteHD'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] enforce_multipath_for_image_xfer = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] filter_function = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_api_insecure = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_api_servers = ['http://192.168.122.143/image'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_api_ssl_compression = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_ca_certificates_file = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_catalog_info = image:glance:publicURL {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_certfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:42 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_keyfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_num_retries = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance_request_timeout = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] goodness_function = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] graceful_shutdown_timeout = 5 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] group_api_class = cinder.group.api.API {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] host = devstack {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_compress_on_upload = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_conversion_address_space_limit = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_conversion_cpu_limit = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_conversion_disable = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_upload_use_cinder_backend = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_upload_use_internal_tenant = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_volume_cache_enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_volume_cache_max_count = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] image_volume_cache_max_size_gb = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] init_host_max_objects_retrieval = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] instance_format = [instance: %(uuid)s] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] iscsi_iotype = fileio {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] iscsi_target_flags = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] iscsi_write_cache = on {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] iser_helper = tgtadm {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] iser_ip_address = 192.168.122.143 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] iser_port = 3260 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_color = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_config_append = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_dir = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_file = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_options = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_rotate_interval = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_rotate_interval_type = days {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] log_rotation_type = none {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] max_age = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] max_logfile_count = 30 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] max_logfile_size_mb = 200 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] max_over_subscription_ratio = 20.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] message_reap_interval = 86400 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] message_ttl = 2592000 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] migration_create_volume_timeout_secs = 300 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] monkey_patch = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] monkey_patch_modules = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] my_ip = 192.168.122.143 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] no_snapshot_gb_quota = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] num_iser_scan_tries = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] num_shell_tries = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] num_volume_device_scan_tries = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] nvmeof_conn_info_version = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] nvmet_ns_id = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] nvmet_port_id = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] osapi_max_limit = 1000 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] osapi_volume_ext_list = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] osapi_volume_listen_port = 8776 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] osapi_volume_use_ssl = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] osapi_volume_workers = 2 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] per_volume_size_limit = -1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] periodic_fuzzy_delay = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] periodic_interval = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] public_endpoint = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] publish_errors = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] quota_backup_gigabytes = 1000 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] quota_backups = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] quota_gigabytes = 1000 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] quota_groups = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] quota_snapshots = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] quota_volumes = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] rate_limit_burst = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] rate_limit_except_level = CRITICAL {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] rate_limit_interval = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] reinit_driver_count = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] replication_device = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] report_discard_supported = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] report_interval = 120 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] reservation_clean_interval = 86400 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] reservation_expire = 86400 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] reserved_image_namespaces = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] reserved_percentage = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] rpc_response_timeout = 120 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] run_external_periodic_tasks = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] scst_target_driver = iscsi {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] scst_target_iqn_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_down_time = 720 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] shell_completion = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] snapshot_name_template = snapshot-%s {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] split_loggers = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] state_path = /opt/stack/data/cinder {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] storage_availability_zone = nova {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] storage_protocol = iSCSI {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] syslog_log_facility = LOG_USER {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] target_helper = lioadm {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] target_ip_address = 192.168.122.143 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] target_port = 3260 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] target_protocol = iscsi {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] target_secondary_ip_addresses = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] trace_flags = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] transport_url = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] until_refresh = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] use_chap_auth = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] use_default_quota_class = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] use_journal = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] use_json = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] use_multipath_for_image_xfer = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] use_stderr = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] use_syslog = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] verify_glance_signatures = enabled {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_api_class = cinder.volume.api.API {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_backend_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_clear = zero {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_clear_ionice = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_clear_size = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_copy_bps_limit = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_dd_blocksize = 1M {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_name_template = volume-%s {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_service_inithost_offload = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volume_usage_audit_period = month {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] watch_log_file = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] zoning_mode = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_concurrency.disable_process_locking = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.admin_password = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.admin_token = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.admin_user = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.auth_port = 35357 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.auth_protocol = https {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.auth_section = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.auth_type = password {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.auth_uri = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.auth_version = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.cache = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.certfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.identity_uri = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.include_service_catalog = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.insecure = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.interface = public {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.keyfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_password = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcache_username = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.region_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.service_type = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.backend = dogpile.cache.null {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.backend_argument = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.backend_expiration_time = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.config_prefix = cache.oslo {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.dead_timeout = 60.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.debug_cache_backend = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.enable_retry_client = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.enable_socket_keepalive = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.enforce_fips_mode = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.expiration_time = 600 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.hashclient_retry_attempts = 2 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_dead_retry = 300 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_password = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_pool_maxsize = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_sasl_enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.memcache_username = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.proxies = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.redis_db = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.redis_password = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.redis_server = localhost:6379 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.redis_socket_timeout = 1.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.redis_username = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.retry_attempts = 2 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.retry_delay = 0.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.socket_keepalive_count = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.socket_keepalive_idle = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.socket_keepalive_interval = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.tls_allowed_ciphers = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.tls_cafile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.tls_certfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.tls_enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cache.tls_keyfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] coordination.backend_url = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.asyncio_connection = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.asyncio_slave_connection = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.backend = sqlalchemy {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.connection = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.connection_debug = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.connection_parameters = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.connection_recycle_time = 3600 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.connection_trace = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.db_inc_retry_interval = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.db_max_retries = 20 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.db_max_retry_interval = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.db_retry_interval = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.max_overflow = 50 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.max_pool_size = 5 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.max_retries = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.mysql_wsrep_sync_wait = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.pool_timeout = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.retry_interval = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.slave_connection = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.sqlite_synchronous = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] database.use_db_reconnect = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.connection_string = messaging:// {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.es_doc_type = notification {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.es_scroll_size = 10000 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.es_scroll_time = 2m {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.filter_error_trace = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.hmac_keys = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.sentinel_service_name = mymaster {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.socket_timeout = 0.1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.trace_requests = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler.trace_sqlalchemy = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler_jaeger.process_tags = {} {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler_jaeger.service_name_prefix = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] profiler_otlp.service_name_prefix = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.enforce_new_defaults = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: WARNING oslo_config.cfg [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.enforce_scope = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.policy_default_rule = default {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.policy_file = policy.yaml {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] privsep_osbrick.group = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] privsep_osbrick.helper_command = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] privsep_osbrick.user = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_sys_admin.group = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_sys_admin.helper_command = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] cinder_sys_admin.user = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.auth_section = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.auth_type = password {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.certfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.collect_timing = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.insecure = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.keyfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.send_service_user_token = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.split_loggers = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] service_user.timeout = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.auth_section = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.auth_type = password {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.certfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.collect_timing = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.insecure = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.keyfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.split_loggers = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] glance.timeout = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.backend_availability_zone = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.chap_password = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.chap_username = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.driver_client_cert = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.driver_client_cert_key = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.driver_data_namespace = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.driver_use_ssl = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.extra_capabilities = {} {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.filter_function = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.goodness_function = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.iscsi_iotype = fileio {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.iscsi_target_flags = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.iscsi_write_cache = on {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.iser_helper = tgtadm {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.iser_ip_address = 192.168.122.143 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.iser_port = 3260 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_host = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_login = admin {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_mount_options = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_password = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_private_key = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_share_path = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.num_shell_tries = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.quobyte_volume_url = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.replication_device = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.report_discard_supported = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.reserved_percentage = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.target_helper = tgtadm {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.target_ip_address = 192.168.122.143 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.target_port = 3260 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.target_protocol = iscsi {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.trace_flags = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.unique_fqdn_network = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.use_chap_auth = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volume_backend_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volume_clear = zero {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volume_clear_ionice = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volume_clear_size = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_reports.file_event_handler = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_reports.log_dir = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.backend_availability_zone = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.backend_host = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.chap_password = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.chap_username = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.chiscsi_conf = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.driver_client_cert = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.driver_data_namespace = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.driver_use_ssl = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.extra_capabilities = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.filter_function = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.goodness_function = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Starting volume driver QuobyteDriver (1.1.13) Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.iscsi_iotype = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.iser_helper = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.iser_ip_address = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.iser_port = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.iser_target_prefix = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_host = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_login = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_mount_options = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_password = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_private_key = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_share_path = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_ssh_port = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83184) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.num_shell_tries = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.nvmet_port_id = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.replication_device = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.report_discard_supported = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.reserved_percentage = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.scst_target_driver = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.storage_protocol = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.target_helper = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.target_ip_address = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.target_port = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.target_prefix = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.target_protocol = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.trace_flags = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.use_chap_auth = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volume_clear = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volume_clear_size = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] QuobyteHD.volumes_dir = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.ssl = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_notifications.driver = [] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_notifications.retry = -1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] key_manager.fixed_key = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.barbican_api_version = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.barbican_endpoint = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.barbican_endpoint_type = public {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.barbican_region_name = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.cafile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.certfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.collect_timing = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.insecure = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.keyfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.number_of_retries = 60 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.retry_delay = 1 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.send_service_user_token = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.split_loggers = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.timeout = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.verify_ssl = True {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican.verify_ssl_path = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.auth_section = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.auth_type = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.cafile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.certfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.collect_timing = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.insecure = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.keyfile = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.split_loggers = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] barbican_service_user.timeout = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.approle_role_id = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.approle_secret_id = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.kv_mountpoint = secret {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.kv_path = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.kv_version = 2 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.namespace = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.root_token_id = **** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.ssl_ca_crt_file = None {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.timeout = 60.0 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.use_ssl = False {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 18 11:23:43 devstack cinder-volume[82979]: DEBUG oslo_service.backend._eventlet.service [None req-3f17c61d-5e05-47a0-ab2e-1da76e5efc32 None None] ******************************************************************************** {{(pid=82979) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 18 11:23:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83184) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 18 11:23:43 devstack cinder-volume[83184]: INFO cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 18 11:23:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Running cmd (subprocess): mount.quobyte {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:43 devstack quobyte-client[83196]: Reading configuration file: /etc/quobyte/client.cfg Sep 18 11:23:43 devstack quobyte-client[83196]: Invalid parameters found, error: missing mount point. Sep 18 11:23:43 devstack quobyte-client[83196]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 18 11:23:43 devstack quobyte-client[83196]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 18 11:23:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] CMD "mount.quobyte" returned: 1 in 0.385s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:23:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:23:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:23:43 devstack cinder-volume[83184]: INFO cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Mounting volume: 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d ... Sep 18 11:23:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 -c /etc/quobyte/client-cinder.cfg {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:44 devstack quobyte-client[83206]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 18 11:23:44 devstack quobyte-client[83206]: Reading configuration file: /etc/quobyte/client.cfg Sep 18 11:23:44 devstack quobyte-client[83206]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184' to display the log. Sep 18 11:23:44 devstack quobyte-client[83210]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 18 11:23:44 devstack quobyte-client[83210]: mount.quobyte 3.25 (4fbbd59204) Sep 18 11:23:44 devstack quobyte-client[83210]: Client UUID: a9iDgNat-ZteH-RxJi-YSJN-tL2MmAQnzs5g Sep 18 11:23:44 devstack quobyte-client[83210]: Registry: osci01.corp.quobyte.com:7861 Sep 18 11:23:44 devstack quobyte-client[83210]: Volume: cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:23:44 devstack quobyte-client[83210]: FUSE version: 316 Sep 18 11:23:44 devstack quobyte-client[83210]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 18 11:23:44 devstack quobyte-client[83210]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 18 11:23:44 devstack quobyte-client[83210]: Setting total object cache size to 3352297472 bytes Sep 18 11:23:44 devstack quobyte-client[83210]: Using FUSE low-level API Sep 18 11:23:44 devstack quobyte-client[83210]: Caching of uid/gid to user/group name mappings is enabled Sep 18 11:23:44 devstack quobyte-client[83210]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 18 11:23:44 devstack quobyte-client[83210]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 18 11:23:44 devstack quobyte-client[83210]: HTTP server started on port 55000 Sep 18 11:23:44 devstack quobyte-client[83210]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 18 11:23:44 devstack quobyte-client[83210]: Mount point /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 established Sep 18 11:23:44 devstack quobyte-client[83210]: TimeSync is running and remote sync every 60 seconds Sep 18 11:23:44 devstack quobyte-client[83210]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 18 11:23:44 devstack quobyte-client[83210]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 18 11:23:44 devstack quobyte-client[83210]: Opening volume cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d (1c101dd5-04c5-41fc-89db-c25939916d9d) Sep 18 11:23:44 devstack quobyte-client[83210]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 18 11:23:44 devstack quobyte-client[83210]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 18 11:23:44 devstack quobyte-client[83210]: Failed to invalidate inode: 38: Function not implemented Sep 18 11:23:44 devstack quobyte-client[83210]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 18 11:23:44 devstack quobyte-client[83210]: Automatic minidump upload enabled by global system configuration Sep 18 11:23:44 devstack quobyte-client[83210]: Announcing HTTP status server address 172.24.4.1 Sep 18 11:23:44 devstack quobyte-client[83210]: Registered as service (uuid a9iDgNat-ZteH-RxJi-YSJN-tL2MmAQnzs5g) Sep 18 11:23:44 devstack quobyte-client[83210]: Quobyte Client running as pid 83210 Sep 18 11:23:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.723s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:44 devstack quobyte-client[83210]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 18 11:23:44 devstack quobyte-client[83210]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 18 11:23:44 devstack cinder-volume[83184]: INFO cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Mounting volume: 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d succeeded Sep 18 11:23:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:23:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.777s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:23:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:44 devstack quobyte-client[83210]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 18 11:23:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.077s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:44 devstack cinder-volume[83184]: INFO cinder.volume.driver [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Driver hasn't implemented _init_vendor_properties() Sep 18 11:23:44 devstack cinder-volume[83184]: DEBUG cinder.volume.driver [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83184) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 18 11:23:44 devstack cinder-volume[83184]: DEBUG oslo_db.sqlalchemy.engines [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writer thread running {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.db.sqlalchemy.api [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Building query based on filter {{(pid=83184) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83184) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 18 11:23:45 devstack cinder-volume[83184]: INFO cinder.keymgr.migration [None req-6380bf25-6b59-4b4b-a3bd-9c9b7c1464c9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.118s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:23:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Driver initialization completed successfully. Sep 18 11:23:45 devstack cinder-volume[83184]: INFO cinder.manager [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Initiating service 3 cleanup Sep 18 11:23:45 devstack cinder-volume[83184]: INFO cinder.manager [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Service 3 cleanup completed. Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.service [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Creating RPC server for service cinder-volume {{(pid=83184) start /opt/stack/cinder/cinder/service.py:239}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.service [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83184) start /opt/stack/cinder/cinder/service.py:245}} Sep 18 11:23:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 18 11:23:45 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:23:45 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:23:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:23:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.125s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:23:46 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6230465c-c368-4305-b9c1-27e0fa8c1046 None None] Driver post RPC initialization completed successfully. Sep 18 11:23:47 devstack quobyte-client[83210]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 18 11:23:52 devstack cinder-volume[82979]: DEBUG dbcounter [-] [82979] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82979) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:23:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:23:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.143s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:24:43 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:24:55 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Flow 'volume_create_manager' (97d1f771-f0a5-4248-b980-994c78373c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfba5cf1-4662-4844-ad36-89451dab893f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfba5cf1-4662-4844-ad36-89451dab893f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-2126937748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfd4891-2bac-4d3e-938e-c1c4e43a6d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc991a3b2f524588a0b8c2e606f45f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:24:55Z,use_quota=True,user_id='291277c8567a475f970c611477aa0a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7012cd4d-8500-4f4f-9b28-44a41b21487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7012cd4d-8500-4f4f-9b28-44a41b21487c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f4c5e5-3cdf-400f-9af8-870184d4a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f4c5e5-3cdf-400f-9af8-870184d4a45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfd4891-2bac-4d3e-938e-c1c4e43a6d18', 'volume_name': 'volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7b663c-158e-4b74-a4da-1482a92fb6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7b663c-158e-4b74-a4da-1482a92fb6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0df18e-3be0-413e-a878-8e63e73b95ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:24:56 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Volume 9dfd4891-2bac-4d3e-938e-c1c4e43a6d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18', 'volume_size': 1} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:24:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-2126937748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfd4891-2bac-4d3e-938e-c1c4e43a6d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc991a3b2f524588a0b8c2e606f45f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:24:55Z,use_quota=True,user_id='291277c8567a475f970c611477aa0a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:24:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Creating volume 9dfd4891-2bac-4d3e-938e-c1c4e43a6d18 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:24:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:24:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:24:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:24:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:24:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:24:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:24:57 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:24:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:24:57 devstack quobyte-client[83210]: System call of process 83555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:24:57 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=2, name=volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:24:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18 1073741824" returned: 0 in 1.158s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:24:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:24:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18" returned: 0 in 0.297s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:24:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] <== create_volume: return (1546ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:24:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:24:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0df18e-3be0-413e-a878-8e63e73b95ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:24:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359951a0-dfd2-4446-97f2-d6d6253bea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:24:59 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Volume volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18 (9dfd4891-2bac-4d3e-938e-c1c4e43a6d18): created successfully Sep 18 11:24:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359951a0-dfd2-4446-97f2-d6d6253bea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:24:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Flow 'volume_create_manager' (97d1f771-f0a5-4248-b980-994c78373c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:24:59 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4082d817-bdcb-4112-99e5-a54f88fa806a tempest-VolumesAssistedSnapshotsTest-1080847985 None] Created volume successfully. Sep 18 11:25:09 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:25:09 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:25:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:25:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:25:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:25:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:25:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:25:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:25:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:25:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.828s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:25:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:25:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:25:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:25:56 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:25:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Flow 'volume_create_manager' (c4d2da42-4d9d-44a9-89a4-47f6393c6ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:25:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f70c15e-c17a-4e29-8072-ae92c4420b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f70c15e-c17a-4e29-8072-ae92c4420b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1508942393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec9fa239ab1471a9158beaa83ed0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:25:56Z,use_quota=True,user_id='8aa233571c6542a9b7adad21038c5550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1755cc8f-0802-4de4-aeb3-71a04e571c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1755cc8f-0802-4de4-aeb3-71a04e571c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca5d5e1-be78-45f3-921e-8ef973145fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca5d5e1-be78-45f3-921e-8ef973145fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a', 'volume_name': 'volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2289f0-af34-4a45-82e0-0f23bc4e06cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2289f0-af34-4a45-82e0-0f23bc4e06cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63ddfa1-e80e-43a4-ab0d-f7745a50161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:25:57 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Volume 32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a', 'volume_size': 1} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1508942393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec9fa239ab1471a9158beaa83ed0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:25:56Z,use_quota=True,user_id='8aa233571c6542a9b7adad21038c5550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Creating volume 32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:25:57 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:25:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:25:57 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=3, name=volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a 1073741824" returned: 0 in 0.657s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a" returned: 0 in 0.410s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] <== create_volume: return (1331ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63ddfa1-e80e-43a4-ab0d-f7745a50161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee3c225-073b-4618-9e63-0c2e9e095d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:25:58 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Volume volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a (32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a): created successfully Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee3c225-073b-4618-9e63-0c2e9e095d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:25:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Flow 'volume_create_manager' (c4d2da42-4d9d-44a9-89a4-47f6393c6ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:25:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0932338d-3ed3-4b6d-8bd0-8bcd6d3d3109 tempest-DeleteServersTestJSON-1488763588 None] Created volume successfully. Sep 18 11:26:02 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Flow 'volume_create_manager' (c331872d-db10-49d9-8ef5-06813f0e4c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f0606-3845-452f-88c3-3181b34b3bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f0606-3845-452f-88c3-3181b34b3bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2038910362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e1eacf-4d99-4ac4-97e8-0e12f47b0d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3759129b45d4dd29870c9a35d9f491f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:26:02Z,use_quota=True,user_id='f1007900157e41059e45b042e8f1aad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2faaae1-3947-4dca-aa5f-a3c7ca4580a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2faaae1-3947-4dca-aa5f-a3c7ca4580a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f660f93e-17f8-49ac-b7e3-eb0cee99a585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f660f93e-17f8-49ac-b7e3-eb0cee99a585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e1eacf-4d99-4ac4-97e8-0e12f47b0d28', 'volume_name': 'volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcbcf10-5eb5-4b9b-af01-4c8df0666118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcbcf10-5eb5-4b9b-af01-4c8df0666118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5cfd97-2b98-4452-a08a-11238ed518bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:26:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Volume 87e1eacf-4d99-4ac4-97e8-0e12f47b0d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28', 'volume_size': 1} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2038910362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e1eacf-4d99-4ac4-97e8-0e12f47b0d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3759129b45d4dd29870c9a35d9f491f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:26:02Z,use_quota=True,user_id='f1007900157e41059e45b042e8f1aad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Creating volume 87e1eacf-4d99-4ac4-97e8-0e12f47b0d28 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:26:02 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:26:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:03 devstack quobyte-client[83210]: System call of process 84506 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:26:03 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=4, name=volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:26:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28 1073741824" returned: 0 in 0.655s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28" returned: 0 in 0.406s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] <== create_volume: return (1213ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:26:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:26:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5cfd97-2b98-4452-a08a-11238ed518bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:26:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cd1fa0-4c24-4019-8360-be291cffb364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:26:04 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Volume volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28 (87e1eacf-4d99-4ac4-97e8-0e12f47b0d28): created successfully Sep 18 11:26:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cd1fa0-4c24-4019-8360-be291cffb364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:26:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Flow 'volume_create_manager' (c331872d-db10-49d9-8ef5-06813f0e4c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:26:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ecf0cb71-f93f-43c2-8053-5d46ed75ac37 tempest-VolumesAdminNegativeTest-1563215978 None] Created volume successfully. Sep 18 11:26:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Acquiring lock "cinder-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:26:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Lock "cinder-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:26:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:26:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Acquiring lock "cinder-quobyte-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:26:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Lock "cinder-quobyte-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28" acquired by "delete_volume" :: waited 0.022s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:26:07 devstack cinder-volume[83184]: INFO oslo.privsep.daemon [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvxeyyh3g/privsep.sock'] Sep 18 11:26:07 devstack sudo[84515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvxeyyh3g/privsep.sock Sep 18 11:26:07 devstack sudo[84515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:26:17 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:26:17 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:26:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:26:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:26:19 devstack sudo[84515]: pam_unix(sudo:session): session closed for user root Sep 18 11:26:19 devstack cinder-volume[83184]: INFO oslo.privsep.daemon [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Spawned new privsep daemon via rootwrap Sep 18 11:26:19 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Accepted privsep connection to /tmp/tmpvxeyyh3g/privsep.sock {{(pid=83184) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 18 11:26:19 devstack cinder-volume[83184]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 18 11:26:19 devstack cinder-volume[83184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 18 11:26:19 devstack cinder-volume[83184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 18 11:26:19 devstack cinder-volume[83184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84522 Sep 18 11:26:19 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[234e650b-5bd5-4acc-a5b6-ed22ad82994c]: (2,) {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:26:19 devstack cinder-volume[83184]: WARNING oslo_privsep.priv_context [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] privsep daemon already running Sep 18 11:26:19 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5468ad-8eea-4641-b263-0008f3b5e0f1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:26:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:19 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa7846e-8f0c-4d3f-8511-8004dd15fbb3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:26:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:20 devstack quobyte-client[83210]: System call of process 84536 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:26:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28" returned: 0 in 0.978s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:20 devstack quobyte-client[83210]: System call of process 84537 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:26:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28" returned: 0 in 0.268s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a" returned: 0 in 1.262s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Lock "cinder-quobyte-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28" released by "delete_volume" :: held 13.432s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:26:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.523s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:26:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7af6e6b-8fcc-4998-8ab7-d205337f1a31', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:26:21 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:26:22 devstack cinder-volume[83184]: WARNING cinder.quota [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:26:22 devstack cinder-volume[83184]: WARNING cinder.quota [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:26:22 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-32d41864-700a-478b-add6-8603a48df491 req-f9582024-d068-4b56-b343-48af4860f349 tempest-DeleteServersTestJSON-1488763588 None] attachment_update completed successfully. Sep 18 11:26:22 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Created reservations ['9bb2c9c1-e7de-4983-bcf2-3e359c825df5', '0f54abd7-7812-4183-b85c-31a0d2c24c32', 'f359f0a1-2140-4962-9513-2fb62980fb0c', '3d9bf922-8ec9-45c0-8c7d-1b75c4dd33be'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:26:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:26:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:26:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:26:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:26:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:26:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.250s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:23 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:26:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Deleted volume successfully. Sep 18 11:26:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-16bae36e-ab4b-4ce6-b210-e813514f2e4c tempest-VolumesAdminNegativeTest-1563215978 None] Lock "cinder-87e1eacf-4d99-4ac4-97e8-0e12f47b0d28-delete_volume" released by "delete_volume" :: held 16.564s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:26:32 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:26:33 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:26:39 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-61a24452-6ae0-446c-8adc-8aac106b4c55 req-d4a4f76f-17e8-4f79-93c6-6792b53a1d97 tempest-DeleteServersTestJSON-1488763588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:26:39 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-61a24452-6ae0-446c-8adc-8aac106b4c55 req-d4a4f76f-17e8-4f79-93c6-6792b53a1d97 tempest-DeleteServersTestJSON-1488763588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:26:39 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-61a24452-6ae0-446c-8adc-8aac106b4c55 req-d4a4f76f-17e8-4f79-93c6-6792b53a1d97 tempest-DeleteServersTestJSON-1488763588 None] Terminate volume connection completed successfully. Sep 18 11:26:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-61a24452-6ae0-446c-8adc-8aac106b4c55 req-d4a4f76f-17e8-4f79-93c6-6792b53a1d97 tempest-DeleteServersTestJSON-1488763588 None] Deleting attachment c7af6e6b-8fcc-4998-8ab7-d205337f1a31. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.132s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:43 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:26:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Acquiring lock "cinder-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:26:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Lock "cinder-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:26:44 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:26:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Acquiring lock "cinder-quobyte-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:26:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Lock "cinder-quobyte-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:26:44 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa7280b-77a2-4888-8906-ad2ffc7270c4]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:26:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a" returned: 0 in 0.726s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a" returned: 0 in 0.143s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Lock "cinder-quobyte-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a" released by "delete_volume" :: held 1.122s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Created reservations ['fd274d88-144b-40f1-8d87-888bff9047f4', 'b97e0d38-b265-4b2f-bf13-70d942764f0d', 'f61e020c-5bc8-4d7d-9152-f0e1f4575366', '09eace85-1632-448f-97fc-759047f03e05'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.114s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:26:46 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Deleted volume successfully. Sep 18 11:26:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-93219af0-f3fe-4456-913f-ba7b599f266f tempest-DeleteServersTestJSON-1488763588 None] Lock "cinder-32ff3b0a-ef94-48c6-ae14-fb4d39db4a9a-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:26:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:26:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:27:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-1ac4a29f-ec5e-4baf-a0f4-de4e44b174f7 req-62e2ad0e-e420-44db-9cb4-f7d6fc207c26 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:27:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-1ac4a29f-ec5e-4baf-a0f4-de4e44b174f7 req-62e2ad0e-e420-44db-9cb4-f7d6fc207c26 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:27:25 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa432203-4d70-4e01-b61d-0af9a5280a33]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:27:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-1ac4a29f-ec5e-4baf-a0f4-de4e44b174f7 req-62e2ad0e-e420-44db-9cb4-f7d6fc207c26 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:27:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-1ac4a29f-ec5e-4baf-a0f4-de4e44b174f7 req-62e2ad0e-e420-44db-9cb4-f7d6fc207c26 tempest-VolumesAssistedSnapshotsTest-1080847985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18" returned: 0 in 1.075s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:27:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-1ac4a29f-ec5e-4baf-a0f4-de4e44b174f7 req-62e2ad0e-e420-44db-9cb4-f7d6fc207c26 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.201s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:27:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-1ac4a29f-ec5e-4baf-a0f4-de4e44b174f7 req-62e2ad0e-e420-44db-9cb4-f7d6fc207c26 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2619c7da-d116-411a-8299-864afd7f8f31', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:27:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-1ac4a29f-ec5e-4baf-a0f4-de4e44b174f7 req-62e2ad0e-e420-44db-9cb4-f7d6fc207c26 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:27:27 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-1ac4a29f-ec5e-4baf-a0f4-de4e44b174f7 req-62e2ad0e-e420-44db-9cb4-f7d6fc207c26 tempest-VolumesAssistedSnapshotsTest-1080847985 None] attachment_update completed successfully. Sep 18 11:27:37 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:27:37 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.119s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:27:43 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:27:55 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Flow 'volume_create_manager' (0f7a002c-a5e6-40d4-9ed8-75d0f628ad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5453d112-5fbb-4d21-be14-d8027705ad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5453d112-5fbb-4d21-be14-d8027705ad98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1736913954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201d45a7-08f8-4161-b2ac-71ed72493f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2817075332544b77955f067095417c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:27:55Z,use_quota=True,user_id='1ee22f9088f844b68708f1fd3d68ebbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e98cc4-edac-454d-8c73-874a458780c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e98cc4-edac-454d-8c73-874a458780c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5681716c-c164-4b31-9f43-f8fc9aa42233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5681716c-c164-4b31-9f43-f8fc9aa42233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201d45a7-08f8-4161-b2ac-71ed72493f6c', 'volume_name': 'volume-201d45a7-08f8-4161-b2ac-71ed72493f6c', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd211f1c-02ff-427e-95dc-2d5d4faae6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd211f1c-02ff-427e-95dc-2d5d4faae6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bc8240-bb62-40ab-80bb-3827a1a01ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:27:55 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Volume 201d45a7-08f8-4161-b2ac-71ed72493f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201d45a7-08f8-4161-b2ac-71ed72493f6c', 'volume_size': 1} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1736913954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201d45a7-08f8-4161-b2ac-71ed72493f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2817075332544b77955f067095417c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:27:55Z,use_quota=True,user_id='1ee22f9088f844b68708f1fd3d68ebbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Creating volume 201d45a7-08f8-4161-b2ac-71ed72493f6c {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:27:55 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:27:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:27:56 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=5, name=volume-201d45a7-08f8-4161-b2ac-71ed72493f6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:27:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c 1073741824" returned: 0 in 0.544s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:27:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:27:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c" returned: 0 in 0.120s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:27:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:27:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] <== create_volume: return (833ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:27:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:27:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bc8240-bb62-40ab-80bb-3827a1a01ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201d45a7-08f8-4161-b2ac-71ed72493f6c', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:27:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ab33d9-da2f-491b-bb3f-38a57de13b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:27:57 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Volume volume-201d45a7-08f8-4161-b2ac-71ed72493f6c (201d45a7-08f8-4161-b2ac-71ed72493f6c): created successfully Sep 18 11:27:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ab33d9-da2f-491b-bb3f-38a57de13b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:27:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Flow 'volume_create_manager' (0f7a002c-a5e6-40d4-9ed8-75d0f628ad6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:27:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7ed20414-0186-40bc-95e1-9b29c4cc19b6 tempest-TaggedAttachmentsTest-1741686494 None] Created volume successfully. Sep 18 11:27:59 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-59f45b4f-6612-4b8b-a6bd-c9d089e87962 req-04e84dfe-5c30-4804-85c3-c895d2aef2e9 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:27:59 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-59f45b4f-6612-4b8b-a6bd-c9d089e87962 req-04e84dfe-5c30-4804-85c3-c895d2aef2e9 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:27:59 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-59f45b4f-6612-4b8b-a6bd-c9d089e87962 req-04e84dfe-5c30-4804-85c3-c895d2aef2e9 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Terminate volume connection completed successfully. Sep 18 11:27:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-59f45b4f-6612-4b8b-a6bd-c9d089e87962 req-04e84dfe-5c30-4804-85c3-c895d2aef2e9 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Deleting attachment 2619c7da-d116-411a-8299-864afd7f8f31. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:28:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Acquiring lock "cinder-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:28:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "cinder-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:28:02 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:28:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Acquiring lock "cinder-quobyte-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:28:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "cinder-quobyte-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:28:02 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb95b7b-f218-45c7-ae5f-afcbc421bbba]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:28:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:28:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18" returned: 0 in 0.611s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:28:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18" returned: 0 in 0.136s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "cinder-quobyte-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18" released by "delete_volume" :: held 0.960s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Created reservations ['e8cbdbe6-fa21-436b-a337-0936f429c4f7', 'acec51a5-ecb1-46e1-ade7-732da7c0912e', '64fa04bd-bb30-43c2-9378-43f19906c14d', '291e8e24-42bb-4d5b-b90f-295d07ad99bf'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.128s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:28:03 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:28:03 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Deleted volume successfully. Sep 18 11:28:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cb36336-6499-4bea-b70a-d4f060adb361 tempest-VolumesAssistedSnapshotsTest-1080847985 None] Lock "cinder-9dfd4891-2bac-4d3e-938e-c1c4e43a6d18-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:28:13 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=6,cinder:DELETE=1,cinder:SELECT=8,cinder:INSERT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:28:14 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:29:00 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:29:00 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:29:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Flow 'volume_create_manager' (93e26a6b-c9a8-4df3-a0c7-3e0d02265bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d259c4-a1a3-4e7a-9ed1-76cceddb9b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d259c4-a1a3-4e7a-9ed1-76cceddb9b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1163624287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fdd437-3c8f-4798-b03d-6dd031f8ec9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4a37079106431f90a090f4bc4d017a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:29:00Z,use_quota=True,user_id='628a0751924e4cfe98db2496cfbf1ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c261535-ba86-49c0-8405-ed41dc6d58d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c261535-ba86-49c0-8405-ed41dc6d58d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a395045f-2b82-4a86-8786-242bf0d65c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a395045f-2b82-4a86-8786-242bf0d65c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33fdd437-3c8f-4798-b03d-6dd031f8ec9e', 'volume_name': 'volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca4c819-8f4a-43e4-9a6b-f8f8ce601996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca4c819-8f4a-43e4-9a6b-f8f8ce601996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556d8121-865d-4991-91f9-48c6ae444d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:29:01 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Volume 33fdd437-3c8f-4798-b03d-6dd031f8ec9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e', 'volume_size': 1} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1163624287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33fdd437-3c8f-4798-b03d-6dd031f8ec9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4a37079106431f90a090f4bc4d017a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:29:00Z,use_quota=True,user_id='628a0751924e4cfe98db2496cfbf1ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Creating volume 33fdd437-3c8f-4798-b03d-6dd031f8ec9e {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:29:01 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:29:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:29:01 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=6, name=volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e 1073741824" returned: 0 in 0.667s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e" returned: 0 in 0.151s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] <== create_volume: return (992ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556d8121-865d-4991-91f9-48c6ae444d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5a34dc-2119-4389-b583-e9f16c616fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:29:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Volume volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e (33fdd437-3c8f-4798-b03d-6dd031f8ec9e): created successfully Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5a34dc-2119-4389-b583-e9f16c616fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:29:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Flow 'volume_create_manager' (93e26a6b-c9a8-4df3-a0c7-3e0d02265bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:29:02 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-acb7d460-ee66-4420-b9b6-975c86553cda tempest-AttachVolumeTestJSON-1299027502 None] Created volume successfully. Sep 18 11:29:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-15338e5d-aa30-49e5-91b8-718a41432348 req-38c5f0af-a558-4c3e-810f-0f016f32aaa5 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:29:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-15338e5d-aa30-49e5-91b8-718a41432348 req-38c5f0af-a558-4c3e-810f-0f016f32aaa5 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:29:08 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6792ee0-0702-4639-b068-829b92d08322]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:29:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-15338e5d-aa30-49e5-91b8-718a41432348 req-38c5f0af-a558-4c3e-810f-0f016f32aaa5 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:29:09 devstack quobyte-client[83210]: System call of process 86024 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:29:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-15338e5d-aa30-49e5-91b8-718a41432348 req-38c5f0af-a558-4c3e-810f-0f016f32aaa5 tempest-AttachVolumeTestJSON-1299027502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e" returned: 0 in 0.730s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:29:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-15338e5d-aa30-49e5-91b8-718a41432348 req-38c5f0af-a558-4c3e-810f-0f016f32aaa5 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:29:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-15338e5d-aa30-49e5-91b8-718a41432348 req-38c5f0af-a558-4c3e-810f-0f016f32aaa5 tempest-AttachVolumeTestJSON-1299027502 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a7ca426-0540-408a-80d7-d8ce73e654f2', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:29:09 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-15338e5d-aa30-49e5-91b8-718a41432348 req-38c5f0af-a558-4c3e-810f-0f016f32aaa5 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:29:09 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-15338e5d-aa30-49e5-91b8-718a41432348 req-38c5f0af-a558-4c3e-810f-0f016f32aaa5 tempest-AttachVolumeTestJSON-1299027502 None] attachment_update completed successfully. Sep 18 11:29:19 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:29:19 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:29:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:29:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:29:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:29:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:29:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:29:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:29:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:29:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.654s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:29:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:29:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:29:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:30:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-cccc0356-9ae1-458b-8b76-a56971ef2dc6 req-b08fd41f-b293-4793-94f2-e983f9b445fa tempest-TaggedAttachmentsTest-1741686494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:30:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-cccc0356-9ae1-458b-8b76-a56971ef2dc6 req-b08fd41f-b293-4793-94f2-e983f9b445fa tempest-TaggedAttachmentsTest-1741686494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.017s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:30:11 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1809a8-003f-487e-b498-2ae46c0906f0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:30:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-cccc0356-9ae1-458b-8b76-a56971ef2dc6 req-b08fd41f-b293-4793-94f2-e983f9b445fa tempest-TaggedAttachmentsTest-1741686494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:30:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-cccc0356-9ae1-458b-8b76-a56971ef2dc6 req-b08fd41f-b293-4793-94f2-e983f9b445fa tempest-TaggedAttachmentsTest-1741686494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c" returned: 0 in 1.058s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:30:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-cccc0356-9ae1-458b-8b76-a56971ef2dc6 req-b08fd41f-b293-4793-94f2-e983f9b445fa tempest-TaggedAttachmentsTest-1741686494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.192s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:30:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-cccc0356-9ae1-458b-8b76-a56971ef2dc6 req-b08fd41f-b293-4793-94f2-e983f9b445fa tempest-TaggedAttachmentsTest-1741686494 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-201d45a7-08f8-4161-b2ac-71ed72493f6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36cfb494-590a-4852-bf04-b0514df89db3', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:30:13 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-cccc0356-9ae1-458b-8b76-a56971ef2dc6 req-b08fd41f-b293-4793-94f2-e983f9b445fa tempest-TaggedAttachmentsTest-1741686494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:30:13 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-cccc0356-9ae1-458b-8b76-a56971ef2dc6 req-b08fd41f-b293-4793-94f2-e983f9b445fa tempest-TaggedAttachmentsTest-1741686494 None] attachment_update completed successfully. Sep 18 11:30:23 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:30:23 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.131s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:30:43 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:30:47 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-818a53a3-5477-4e5c-984d-860e48c0a224 req-36e6d993-9952-4206-948d-0deeccabe473 tempest-TaggedAttachmentsTest-1741686494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:30:48 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-818a53a3-5477-4e5c-984d-860e48c0a224 req-36e6d993-9952-4206-948d-0deeccabe473 tempest-TaggedAttachmentsTest-1741686494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:30:48 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-818a53a3-5477-4e5c-984d-860e48c0a224 req-36e6d993-9952-4206-948d-0deeccabe473 tempest-TaggedAttachmentsTest-1741686494 None] Terminate volume connection completed successfully. Sep 18 11:30:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-818a53a3-5477-4e5c-984d-860e48c0a224 req-36e6d993-9952-4206-948d-0deeccabe473 tempest-TaggedAttachmentsTest-1741686494 None] Deleting attachment 36cfb494-590a-4852-bf04-b0514df89db3. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:30:57 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:30:58 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:31:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-0fcb68ee-07a3-4dbc-824c-cc1085a7df2c req-20a7777a-07e3-465e-a4c2-ef752cf1e228 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:31:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-0fcb68ee-07a3-4dbc-824c-cc1085a7df2c req-20a7777a-07e3-465e-a4c2-ef752cf1e228 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:31:20 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-0fcb68ee-07a3-4dbc-824c-cc1085a7df2c req-20a7777a-07e3-465e-a4c2-ef752cf1e228 tempest-AttachVolumeTestJSON-1299027502 None] Terminate volume connection completed successfully. Sep 18 11:31:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0fcb68ee-07a3-4dbc-824c-cc1085a7df2c req-20a7777a-07e3-465e-a4c2-ef752cf1e228 tempest-AttachVolumeTestJSON-1299027502 None] Deleting attachment 2a7ca426-0540-408a-80d7-d8ce73e654f2. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:31:29 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:31:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Acquiring lock "cinder-201d45a7-08f8-4161-b2ac-71ed72493f6c-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:31:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Lock "cinder-201d45a7-08f8-4161-b2ac-71ed72493f6c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:31:36 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:31:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Acquiring lock "cinder-quobyte-201d45a7-08f8-4161-b2ac-71ed72493f6c" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:31:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Lock "cinder-quobyte-201d45a7-08f8-4161-b2ac-71ed72493f6c" acquired by "delete_volume" :: waited 0.033s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:31:36 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e3243c-1072-4f03-bf06-ddec5061372f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:31:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:31:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c" returned: 0 in 0.787s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:31:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-201d45a7-08f8-4161-b2ac-71ed72493f6c" returned: 0 in 0.271s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:31:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Flow 'volume_create_manager' (5d26185a-b8c7-4f13-8892-4ac34d3b2cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551c8433-e404-4992-90a3-20c10f16918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Lock "cinder-quobyte-201d45a7-08f8-4161-b2ac-71ed72493f6c" released by "delete_volume" :: held 1.327s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551c8433-e404-4992-90a3-20c10f16918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-830184046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4354f6ec-3026-44dc-8728-8e359bfa6c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ba44238d5642e0832a98f0df39540f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:31:37Z,use_quota=True,user_id='68ee52a177764e918d7dc291b6dbba6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d809c4c1-610d-4d99-8d84-7804738c336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d809c4c1-610d-4d99-8d84-7804738c336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d6f43c-ec62-417f-a5b0-fbf3457e8706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d6f43c-ec62-417f-a5b0-fbf3457e8706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4354f6ec-3026-44dc-8728-8e359bfa6c31', 'volume_name': 'volume-4354f6ec-3026-44dc-8728-8e359bfa6c31', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9746faf7-2cf7-4029-acf0-d6362969c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9746faf7-2cf7-4029-acf0-d6362969c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18a9fd0-067d-4628-882d-1d87d5db0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:31:37 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Volume 4354f6ec-3026-44dc-8728-8e359bfa6c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4354f6ec-3026-44dc-8728-8e359bfa6c31', 'volume_size': 1} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-830184046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4354f6ec-3026-44dc-8728-8e359bfa6c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ba44238d5642e0832a98f0df39540f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:31:37Z,use_quota=True,user_id='68ee52a177764e918d7dc291b6dbba6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Creating volume 4354f6ec-3026-44dc-8728-8e359bfa6c31 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:31:37 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:31:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:31:37 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=7, name=volume-4354f6ec-3026-44dc-8728-8e359bfa6c31, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31 1073741824" returned: 0 in 0.547s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Created reservations ['fb52a655-2ec1-4729-853b-a1de7c8d3538', '39a7106d-ca18-47f2-ab75-2f986f8478e1', '08c2b089-16d9-4627-aed4-0a55dbf8aa30', 'f0c408e3-ba39-4cd2-aa31-61e0b7688bb8'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31" returned: 0 in 0.296s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] <== create_volume: return (875ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18a9fd0-067d-4628-882d-1d87d5db0f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4354f6ec-3026-44dc-8728-8e359bfa6c31', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1159684-cf14-45f9-90e9-97ba60c8071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:31:38 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Volume volume-4354f6ec-3026-44dc-8728-8e359bfa6c31 (4354f6ec-3026-44dc-8728-8e359bfa6c31): created successfully Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1159684-cf14-45f9-90e9-97ba60c8071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Flow 'volume_create_manager' (5d26185a-b8c7-4f13-8892-4ac34d3b2cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:31:38 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7dc5ca96-a19e-4267-bca5-61332a543e44 tempest-AttachSCSIVolumeTestJSON-671086052 None] Created volume successfully. Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.125s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:31:38 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:31:38 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Deleted volume successfully. Sep 18 11:31:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-153bfc16-c433-4165-ad8e-15c2fe5af661 tempest-TaggedAttachmentsTest-1741686494 None] Lock "cinder-201d45a7-08f8-4161-b2ac-71ed72493f6c-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.223s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:31:43 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:31:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-dca2d970-5b22-4243-bbcc-c13f3aad3688 req-5a226ed8-97e4-4f7f-8bb3-3fc33d9aeb68 tempest-AttachSCSIVolumeTestJSON-671086052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:31:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-dca2d970-5b22-4243-bbcc-c13f3aad3688 req-5a226ed8-97e4-4f7f-8bb3-3fc33d9aeb68 tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:31:45 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4621c7d-d3d3-4072-a328-756c50304f00]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:31:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-dca2d970-5b22-4243-bbcc-c13f3aad3688 req-5a226ed8-97e4-4f7f-8bb3-3fc33d9aeb68 tempest-AttachSCSIVolumeTestJSON-671086052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:31:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-dca2d970-5b22-4243-bbcc-c13f3aad3688 req-5a226ed8-97e4-4f7f-8bb3-3fc33d9aeb68 tempest-AttachSCSIVolumeTestJSON-671086052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31" returned: 0 in 0.942s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:31:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-dca2d970-5b22-4243-bbcc-c13f3aad3688 req-5a226ed8-97e4-4f7f-8bb3-3fc33d9aeb68 tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.999s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:31:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-dca2d970-5b22-4243-bbcc-c13f3aad3688 req-5a226ed8-97e4-4f7f-8bb3-3fc33d9aeb68 tempest-AttachSCSIVolumeTestJSON-671086052 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-4354f6ec-3026-44dc-8728-8e359bfa6c31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e36ed61d-cf12-485a-a55b-414be8176628', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:31:46 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-dca2d970-5b22-4243-bbcc-c13f3aad3688 req-5a226ed8-97e4-4f7f-8bb3-3fc33d9aeb68 tempest-AttachSCSIVolumeTestJSON-671086052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:31:47 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-dca2d970-5b22-4243-bbcc-c13f3aad3688 req-5a226ed8-97e4-4f7f-8bb3-3fc33d9aeb68 tempest-AttachSCSIVolumeTestJSON-671086052 None] attachment_update completed successfully. Sep 18 11:31:57 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=11,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:31:57 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=7,cinder:SELECT=13,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:32:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-32a39c53-6e5e-4de3-a8c6-421c7a4e6cc2 req-94ccd293-3e30-4831-93d6-da500dea85e0 tempest-AttachSCSIVolumeTestJSON-671086052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:32:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-32a39c53-6e5e-4de3-a8c6-421c7a4e6cc2 req-94ccd293-3e30-4831-93d6-da500dea85e0 tempest-AttachSCSIVolumeTestJSON-671086052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:32:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-32a39c53-6e5e-4de3-a8c6-421c7a4e6cc2 req-94ccd293-3e30-4831-93d6-da500dea85e0 tempest-AttachSCSIVolumeTestJSON-671086052 None] Terminate volume connection completed successfully. Sep 18 11:32:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-32a39c53-6e5e-4de3-a8c6-421c7a4e6cc2 req-94ccd293-3e30-4831-93d6-da500dea85e0 tempest-AttachSCSIVolumeTestJSON-671086052 None] Deleting attachment e36ed61d-cf12-485a-a55b-414be8176628. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:32:29 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:32:29 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:32:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Acquiring lock "cinder-4354f6ec-3026-44dc-8728-8e359bfa6c31-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:32:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "cinder-4354f6ec-3026-44dc-8728-8e359bfa6c31-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:32:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:32:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Acquiring lock "cinder-quobyte-4354f6ec-3026-44dc-8728-8e359bfa6c31" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:32:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "cinder-quobyte-4354f6ec-3026-44dc-8728-8e359bfa6c31" acquired by "delete_volume" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:32:37 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6702ea1e-3b4a-4558-89e2-919f4c87c0f5]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:32:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:32:38 devstack quobyte-client[83210]: System call of process 88259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:32:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31" returned: 0 in 0.888s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:32:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:32:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4354f6ec-3026-44dc-8728-8e359bfa6c31" returned: 0 in 0.149s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:32:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "cinder-quobyte-4354f6ec-3026-44dc-8728-8e359bfa6c31" released by "delete_volume" :: held 1.264s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Created reservations ['183012e7-2a91-479f-a1c3-7a5ed0e34969', 'f3198299-4229-43a7-b983-c1d330c882c0', '04e4c0c8-5f16-4c93-bdbd-1c1682b53737', 'e4156c66-5a6c-40a4-a0fb-5952b3fbc9b8'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.115s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:32:39 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Deleted volume successfully. Sep 18 11:32:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b99ad016-f837-4a4b-8d12-68844163e86b tempest-AttachSCSIVolumeTestJSON-671086052 None] Lock "cinder-4354f6ec-3026-44dc-8728-8e359bfa6c31-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:32:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:32:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:32:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:32:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:32:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:32:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:32:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:32:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.316s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:32:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:32:49 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:32:49 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:33:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:33:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:33:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:33:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:33:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:33:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:33:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:33:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.342s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:33:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:33:53 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:33:53 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:33:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Flow 'volume_create_manager' (2370317f-89f2-46f5-ad8f-38518da9ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56419091-a4f0-4bae-b6ea-3748c2b95df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56419091-a4f0-4bae-b6ea-3748c2b95df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-17635668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b75de3-5e6c-4603-ae72-5238973351b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4fe5f842274b4990f2951012fbc7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:33:53Z,use_quota=True,user_id='3d482577f9f84a13ba87402afe83bb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970717fa-e002-4247-8372-0143a46940ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970717fa-e002-4247-8372-0143a46940ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7839c80-64b2-4775-9c61-4c6914e33bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7839c80-64b2-4775-9c61-4c6914e33bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b75de3-5e6c-4603-ae72-5238973351b9', 'volume_name': 'volume-41b75de3-5e6c-4603-ae72-5238973351b9', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cc6db9-94de-46f1-b63c-00cba8398c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cc6db9-94de-46f1-b63c-00cba8398c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d48842-4e29-4585-bcf3-100989b818d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:33:54 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Volume 41b75de3-5e6c-4603-ae72-5238973351b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b75de3-5e6c-4603-ae72-5238973351b9', 'volume_size': 1} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-17635668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b75de3-5e6c-4603-ae72-5238973351b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4fe5f842274b4990f2951012fbc7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:33:53Z,use_quota=True,user_id='3d482577f9f84a13ba87402afe83bb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Creating volume 41b75de3-5e6c-4603-ae72-5238973351b9 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:33:54 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:33:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-41b75de3-5e6c-4603-ae72-5238973351b9 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:33:54 devstack quobyte-client[83210]: System call of process 88713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:33:54 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=8, name=volume-41b75de3-5e6c-4603-ae72-5238973351b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:33:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-41b75de3-5e6c-4603-ae72-5238973351b9 1073741824" returned: 0 in 0.790s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:33:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-41b75de3-5e6c-4603-ae72-5238973351b9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:33:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-41b75de3-5e6c-4603-ae72-5238973351b9" returned: 0 in 0.218s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:33:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] <== create_volume: return (1192ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:33:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:33:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d48842-4e29-4585-bcf3-100989b818d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b75de3-5e6c-4603-ae72-5238973351b9', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:33:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814a06fe-cfaf-485b-9120-67157ca12cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:33:57 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Volume volume-41b75de3-5e6c-4603-ae72-5238973351b9 (41b75de3-5e6c-4603-ae72-5238973351b9): created successfully Sep 18 11:33:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814a06fe-cfaf-485b-9120-67157ca12cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:33:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Flow 'volume_create_manager' (2370317f-89f2-46f5-ad8f-38518da9ce41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:33:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b429838c-a67f-4895-8d28-f488df8f0f7a tempest-ServersNegativeTestJSON-746395662 None] Created volume successfully. Sep 18 11:34:03 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Flow 'volume_create_manager' (13b8a885-f5eb-45ac-94ac-9c7232840f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5200e054-7146-46a7-8e75-b79a1abd9690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5200e054-7146-46a7-8e75-b79a1abd9690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1281038938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e391717a-7318-4519-a7b0-33559fd8852e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4fe5f842274b4990f2951012fbc7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:03Z,use_quota=True,user_id='3d482577f9f84a13ba87402afe83bb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b58a9c-dc9f-4bb5-a575-eddf29518c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b58a9c-dc9f-4bb5-a575-eddf29518c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1b3e6c-7093-4c7f-a440-26ec15f67341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1b3e6c-7093-4c7f-a440-26ec15f67341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e391717a-7318-4519-a7b0-33559fd8852e', 'volume_name': 'volume-e391717a-7318-4519-a7b0-33559fd8852e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd873ce5-602b-4581-bb7d-b6ffbbb22443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd873ce5-602b-4581-bb7d-b6ffbbb22443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319be1d3-2e89-47df-bf06-00e357b4a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:03 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Volume e391717a-7318-4519-a7b0-33559fd8852e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e391717a-7318-4519-a7b0-33559fd8852e', 'volume_size': 1} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1281038938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e391717a-7318-4519-a7b0-33559fd8852e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4fe5f842274b4990f2951012fbc7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:03Z,use_quota=True,user_id='3d482577f9f84a13ba87402afe83bb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Creating volume e391717a-7318-4519-a7b0-33559fd8852e {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:34:03 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:34:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e391717a-7318-4519-a7b0-33559fd8852e 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:04 devstack quobyte-client[83210]: System call of process 88791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:34:04 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=9, name=volume-e391717a-7318-4519-a7b0-33559fd8852e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:34:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e391717a-7318-4519-a7b0-33559fd8852e 1073741824" returned: 0 in 0.899s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e391717a-7318-4519-a7b0-33559fd8852e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e391717a-7318-4519-a7b0-33559fd8852e" returned: 0 in 0.577s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] <== create_volume: return (1743ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:34:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319be1d3-2e89-47df-bf06-00e357b4a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e391717a-7318-4519-a7b0-33559fd8852e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd4abf1-df2b-4a42-995a-da2056cd5f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:06 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Volume volume-e391717a-7318-4519-a7b0-33559fd8852e (e391717a-7318-4519-a7b0-33559fd8852e): created successfully Sep 18 11:34:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd4abf1-df2b-4a42-995a-da2056cd5f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Flow 'volume_create_manager' (13b8a885-f5eb-45ac-94ac-9c7232840f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:34:06 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4da5b346-a753-43bd-9df8-c82c3dc10f03 tempest-ServersNegativeTestJSON-746395662 None] Created volume successfully. Sep 18 11:34:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "cinder-e391717a-7318-4519-a7b0-33559fd8852e-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:34:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Lock "cinder-e391717a-7318-4519-a7b0-33559fd8852e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:34:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:34:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "cinder-quobyte-e391717a-7318-4519-a7b0-33559fd8852e" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:34:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Lock "cinder-quobyte-e391717a-7318-4519-a7b0-33559fd8852e" acquired by "delete_volume" :: waited 0.036s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:34:16 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab55b07b-f9ab-4ec3-9e88-6c5d24a1e925]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:34:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e391717a-7318-4519-a7b0-33559fd8852e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e391717a-7318-4519-a7b0-33559fd8852e" returned: 0 in 1.053s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e391717a-7318-4519-a7b0-33559fd8852e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e391717a-7318-4519-a7b0-33559fd8852e" returned: 0 in 0.186s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Lock "cinder-quobyte-e391717a-7318-4519-a7b0-33559fd8852e" released by "delete_volume" :: held 1.625s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Created reservations ['6f91b028-246f-4738-80fe-5da90f0386e3', '9050df90-2b1f-43f8-b500-28a961daf548', '8529a0af-ab71-4c9d-ac51-8ef24355b373', '7c84597a-51bb-45f0-aec2-0b41d245fb98'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.109s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:18 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:34:18 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Deleted volume successfully. Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3bf55558-04f4-4da8-b413-0cd7e61512be tempest-ServersNegativeTestJSON-746395662 None] Lock "cinder-e391717a-7318-4519-a7b0-33559fd8852e-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:34:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Flow 'volume_create_manager' (fdbc17f4-dc45-49fe-844d-3b9ff5487475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d5db92-7795-4903-bc6e-677cffe79f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d5db92-7795-4903-bc6e-677cffe79f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1576161645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe97f67-9145-4811-8302-b00fb30ebab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54587b391ce84b599b32dfb146c01650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:19Z,use_quota=True,user_id='578c0318968f44f183cc1c13e34c42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d8e389-eba4-4339-8a3c-52358e72d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d8e389-eba4-4339-8a3c-52358e72d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2350be-519f-4b05-9c54-645644490c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.image.glance [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Creating Keystone auth plugin from conf {{(pid=83184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "cinder-41b75de3-5e6c-4603-ae72-5238973351b9-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Lock "cinder-41b75de3-5e6c-4603-ae72-5238973351b9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:34:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "cinder-quobyte-41b75de3-5e6c-4603-ae72-5238973351b9" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Lock "cinder-quobyte-41b75de3-5e6c-4603-ae72-5238973351b9" acquired by "delete_volume" :: waited 0.019s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fb48ec-504e-434a-b4b5-2d2d7f8ac460]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:34:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-41b75de3-5e6c-4603-ae72-5238973351b9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2350be-519f-4b05-9c54-645644490c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'abe97f67-9145-4811-8302-b00fb30ebab9', 'volume_name': 'volume-abe97f67-9145-4811-8302-b00fb30ebab9', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e564d8-efb7-4482-9e13-a8a45416b235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e564d8-efb7-4482-9e13-a8a45416b235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aeb5913-9e53-4749-bdba-b67e2c14ca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:20 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Volume abe97f67-9145-4811-8302-b00fb30ebab9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-abe97f67-9145-4811-8302-b00fb30ebab9', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': } Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Cloning abe97f67-9145-4811-8302-b00fb30ebab9 from image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]). {{(pid=83184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-41b75de3-5e6c-4603-ae72-5238973351b9" returned: 0 in 0.757s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-41b75de3-5e6c-4603-ae72-5238973351b9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-41b75de3-5e6c-4603-ae72-5238973351b9" returned: 0 in 0.180s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Lock "cinder-quobyte-41b75de3-5e6c-4603-ae72-5238973351b9" released by "delete_volume" :: held 1.039s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:34:21 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Created reservations ['99d15fce-5505-495c-a7e3-59d04c93c136', '18693b06-ac04-4532-89ca-fb499b87b1a4', '5d19e5c6-dd39-4ab6-a4b6-14ce90ff7d60', 'fe6c342b-dff2-4cbc-b838-7e291bab0b96'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:34:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:34:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:34:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.226s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:22 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:34:22 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD, size 20.69 MB, duration 1.58 sec {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 18 11:34:22 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Image download 20.69 MB at 13.06 MB/s Sep 18 11:34:22 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Deleted volume successfully. Sep 18 11:34:22 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7fa00ec9-a753-4b9e-be4c-b22450e790a6 tempest-ServersNegativeTestJSON-746395662 None] Lock "cinder-41b75de3-5e6c-4603-ae72-5238973351b9-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:34:22 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e3002-9d20-4360-92c0-073d7ca98a76]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:34:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:23 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD Sep 18 11:34:23 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:34:27 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Sep 18 11:34:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD" returned: 0 in 4.895s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:27 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Temporary image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 is fetched for user 578c0318968f44f183cc1c13e34c42ff. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 18 11:34:28 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa89ffc7-8fbf-43b7-a7e6-27ccf2dfe12f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:34:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:28 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD Sep 18 11:34:28 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:34:30 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Sep 18 11:34:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD" returned: 0 in 2.543s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1576161645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe97f67-9145-4811-8302-b00fb30ebab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54587b391ce84b599b32dfb146c01650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:19Z,use_quota=True,user_id='578c0318968f44f183cc1c13e34c42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:34:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Creating volume abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:34:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:34:31 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:31 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=10, name=volume-abe97f67-9145-4811-8302-b00fb30ebab9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 1073741824" returned: 0 in 0.423s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 0 in 0.105s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] <== create_volume: return (612ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:31 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Attempting download of 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}])) to volume abe97f67-9145-4811-8302-b00fb30ebab9. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 18 11:34:32 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c3aa2a-0b7b-4bc4-911e-f9e33ee70b7f]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:34:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_4s3d3ma_ {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_4s3d3ma_" returned: 0 in 0.473s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_4s3d3ma_ {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_4s3d3ma_" returned: 1 in 0.580s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_4s3d3ma_' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:34:33 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b2ecd8-a265-42d9-ac5a-f19686240c51]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:34:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:33 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 was qcow2, converting to raw {{(pid=83184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 18 11:34:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:34 devstack quobyte-client[83210]: System call of process 88940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:34:34 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=10, name=volume-abe97f67-9145-4811-8302-b00fb30ebab9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:34:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 0 in 1.935s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:35 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_1ok85vm6devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 11:34:35 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Converted 112.00 MB image at 56.31 MB/s Sep 18 11:34:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:36 devstack quobyte-client[83210]: System call of process 88947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:34:36 devstack quobyte-client[83210]: System call of process 88947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:34:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 1G" returned: 0 in 0.219s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:36 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c7b7c9-375b-4210-b26a-6c1dd8b481a6]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:34:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:36 devstack quobyte-client[83210]: System call of process 88950 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:34:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 0 in 0.642s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 1 in 0.579s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:34:37 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Downloaded image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}])) to volume abe97f67-9145-4811-8302-b00fb30ebab9 successfully. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 18 11:34:37 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Temporary image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 for user 578c0318968f44f183cc1c13e34c42ff is deleted. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 18 11:34:37 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Marking volume abe97f67-9145-4811-8302-b00fb30ebab9 as bootable. {{(pid=83184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 18 11:34:37 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Copying metadata from image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 to abe97f67-9145-4811-8302-b00fb30ebab9. {{(pid=83184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 11:34:37 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Creating volume glance metadata for volume abe97f67-9145-4811-8302-b00fb30ebab9 backed by image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 11:34:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aeb5913-9e53-4749-bdba-b67e2c14ca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe97f67-9145-4811-8302-b00fb30ebab9', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd048c6-5706-4aae-b7e7-6a68d20910fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:38 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Volume volume-abe97f67-9145-4811-8302-b00fb30ebab9 (abe97f67-9145-4811-8302-b00fb30ebab9): created successfully Sep 18 11:34:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd048c6-5706-4aae-b7e7-6a68d20910fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Flow 'volume_create_manager' (fdbc17f4-dc45-49fe-844d-3b9ff5487475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:34:38 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e05e4772-f2ad-452c-939b-9e6050b3ce5b tempest-TaggedBootDevicesTest-901893937 None] Created volume successfully. Sep 18 11:34:39 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=16,cinder:UPDATE=27,cinder:DELETE=1,cinder:INSERT=11 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:34:39 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:34:39 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:34:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Flow 'volume_create_manager' (e4047993-aec8-4267-9902-51504a3cfbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:34:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4188f819-99a5-456b-b169-8a1849c21577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4188f819-99a5-456b-b169-8a1849c21577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1282513079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec822d0-05d0-4d94-9918-cb5927ec95ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54587b391ce84b599b32dfb146c01650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:40Z,use_quota=True,user_id='578c0318968f44f183cc1c13e34c42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037e9820-b9ef-4289-bae5-7a72aa4d6d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037e9820-b9ef-4289-bae5-7a72aa4d6d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62aaa6e-0378-4021-a1c8-d4418f5344de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62aaa6e-0378-4021-a1c8-d4418f5344de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec822d0-05d0-4d94-9918-cb5927ec95ab', 'volume_name': 'volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90cafaee-8174-47c3-ab76-8c09c214ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90cafaee-8174-47c3-ab76-8c09c214ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cbd51f-1d82-4dc1-8baa-65345dfd5aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:40 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Volume 2ec822d0-05d0-4d94-9918-cb5927ec95ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab', 'volume_size': 1} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1282513079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec822d0-05d0-4d94-9918-cb5927ec95ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54587b391ce84b599b32dfb146c01650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:40Z,use_quota=True,user_id='578c0318968f44f183cc1c13e34c42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Creating volume 2ec822d0-05d0-4d94-9918-cb5927ec95ab {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:34:40 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:40 devstack quobyte-client[83210]: System call of process 88981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:34:40 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=11, name=volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab 1073741824" returned: 0 in 0.486s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab" returned: 0 in 0.167s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] <== create_volume: return (759ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:34:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cbd51f-1d82-4dc1-8baa-65345dfd5aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25730a4-863f-489e-b408-d502b1389c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:41 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Volume volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab (2ec822d0-05d0-4d94-9918-cb5927ec95ab): created successfully Sep 18 11:34:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25730a4-863f-489e-b408-d502b1389c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Flow 'volume_create_manager' (e4047993-aec8-4267-9902-51504a3cfbab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:34:41 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-805e7799-41f7-40bd-b40d-b6f51ca05b43 tempest-TaggedBootDevicesTest-901893937 None] Created volume successfully. Sep 18 11:34:42 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Flow 'volume_create_manager' (787d62fe-4194-4e61-89fb-0c58e49c58da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89385712-7892-47c8-95ad-8f2b92a3a40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89385712-7892-47c8-95ad-8f2b92a3a40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1228153003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9247778-3de3-4db6-bc70-5e526331ea1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54587b391ce84b599b32dfb146c01650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:42Z,use_quota=True,user_id='578c0318968f44f183cc1c13e34c42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa99cb38-cad3-457e-b3fa-b31bde967a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa99cb38-cad3-457e-b3fa-b31bde967a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce385d3b-a36c-49b8-b2a2-1d82c3a1e30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce385d3b-a36c-49b8-b2a2-1d82c3a1e30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9247778-3de3-4db6-bc70-5e526331ea1f', 'volume_name': 'volume-c9247778-3de3-4db6-bc70-5e526331ea1f', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ecd39b-6c4d-4ad7-aa3e-bdb84313b808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ecd39b-6c4d-4ad7-aa3e-bdb84313b808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ee5d3a-fb45-42a4-a279-b70221c66e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:42 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Volume c9247778-3de3-4db6-bc70-5e526331ea1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9247778-3de3-4db6-bc70-5e526331ea1f', 'volume_size': 1} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1228153003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9247778-3de3-4db6-bc70-5e526331ea1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54587b391ce84b599b32dfb146c01650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:34:42Z,use_quota=True,user_id='578c0318968f44f183cc1c13e34c42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Creating volume c9247778-3de3-4db6-bc70-5e526331ea1f {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:34:42 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:34:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:42 devstack quobyte-client[83210]: System call of process 88985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:34:42 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=12, name=volume-c9247778-3de3-4db6-bc70-5e526331ea1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f 1073741824" returned: 0 in 0.426s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f" returned: 0 in 0.130s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] <== create_volume: return (654ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:34:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:34:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ee5d3a-fb45-42a4-a279-b70221c66e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9247778-3de3-4db6-bc70-5e526331ea1f', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641ee6b5-955f-43e9-abe5-010a576b7abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:34:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.392s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:34:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:34:44 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Volume volume-c9247778-3de3-4db6-bc70-5e526331ea1f (c9247778-3de3-4db6-bc70-5e526331ea1f): created successfully Sep 18 11:34:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641ee6b5-955f-43e9-abe5-010a576b7abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:34:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Flow 'volume_create_manager' (787d62fe-4194-4e61-89fb-0c58e49c58da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:34:44 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-972227ff-fdb4-4c72-9aff-0a26f21b6399 tempest-TaggedBootDevicesTest-901893937 None] Created volume successfully. Sep 18 11:34:54 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:DELETE=5,cinder:INSERT=10 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:34:54 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:35:18 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Flow 'volume_create_manager' (1e702d8d-4d66-4c0d-a4b9-3d6850cacdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6077e93-3695-4edf-9aa7-68d761988294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6077e93-3695-4edf-9aa7-68d761988294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1236719970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b615afe-46de-4e74-a5b0-323dc7cb0384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4a37079106431f90a090f4bc4d017a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:35:18Z,use_quota=True,user_id='628a0751924e4cfe98db2496cfbf1ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cae283d-afc0-412f-843d-9499d9299591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cae283d-afc0-412f-843d-9499d9299591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60d3460-b9e1-48ed-903b-3e26d51d6307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60d3460-b9e1-48ed-903b-3e26d51d6307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b615afe-46de-4e74-a5b0-323dc7cb0384', 'volume_name': 'volume-9b615afe-46de-4e74-a5b0-323dc7cb0384', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac873430-5fee-4a2a-a620-52befb6acd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac873430-5fee-4a2a-a620-52befb6acd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6bec97-54c0-478c-bd78-4f622849334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:18 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Volume 9b615afe-46de-4e74-a5b0-323dc7cb0384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b615afe-46de-4e74-a5b0-323dc7cb0384', 'volume_size': 1} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1236719970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b615afe-46de-4e74-a5b0-323dc7cb0384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4a37079106431f90a090f4bc4d017a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:35:18Z,use_quota=True,user_id='628a0751924e4cfe98db2496cfbf1ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Creating volume 9b615afe-46de-4e74-a5b0-323dc7cb0384 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:35:18 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:18 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=13, name=volume-9b615afe-46de-4e74-a5b0-323dc7cb0384, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:35:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384 1073741824" returned: 0 in 0.373s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384" returned: 0 in 0.124s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:19 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] <== create_volume: return (658ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:35:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6bec97-54c0-478c-bd78-4f622849334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b615afe-46de-4e74-a5b0-323dc7cb0384', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3bc8cc-38c5-480e-97e9-40587f4dfd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:19 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Volume volume-9b615afe-46de-4e74-a5b0-323dc7cb0384 (9b615afe-46de-4e74-a5b0-323dc7cb0384): created successfully Sep 18 11:35:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3bc8cc-38c5-480e-97e9-40587f4dfd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Flow 'volume_create_manager' (1e702d8d-4d66-4c0d-a4b9-3d6850cacdc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:35:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-91a8b322-6e83-4b45-9a06-e89195d79667 tempest-AttachVolumeTestJSON-1299027502 None] Created volume successfully. Sep 18 11:35:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:21 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b172862-07bd-4e82-b6b2-fc14aa82716b]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:35:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 0 in 0.695s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:23 devstack quobyte-client[83210]: System call of process 89102 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:35:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 1 in 0.878s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:35:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.811s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-abe97f67-9145-4811-8302-b00fb30ebab9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '547abff9-02e3-4a4a-8155-15cdf15d6e01', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:35:23 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:35:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8dd500d1-5e67-4251-9709-13b60b0da98b tempest-TaggedBootDevicesTest-901893937 None] attachment_update completed successfully. Sep 18 11:35:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b7e2415b-6636-4690-9496-10a8d758ad26 req-362ca29d-3991-44cd-8279-d83a9e3859ce tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b7e2415b-6636-4690-9496-10a8d758ad26 req-362ca29d-3991-44cd-8279-d83a9e3859ce tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:27 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[533fed9a-34e0-491e-8e70-46491f4ddd17]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:35:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b7e2415b-6636-4690-9496-10a8d758ad26 req-362ca29d-3991-44cd-8279-d83a9e3859ce tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:29 devstack quobyte-client[83210]: System call of process 89167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:35:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b7e2415b-6636-4690-9496-10a8d758ad26 req-362ca29d-3991-44cd-8279-d83a9e3859ce tempest-AttachVolumeTestJSON-1299027502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384" returned: 0 in 2.066s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b7e2415b-6636-4690-9496-10a8d758ad26 req-362ca29d-3991-44cd-8279-d83a9e3859ce tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.276s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-2775c9df-d637-411f-b689-57089fcdc7f8 tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-2775c9df-d637-411f-b689-57089fcdc7f8 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:30 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[047acdd0-8b94-4c8f-bca1-922ddda0027d]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:35:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-2775c9df-d637-411f-b689-57089fcdc7f8 tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b7e2415b-6636-4690-9496-10a8d758ad26 req-362ca29d-3991-44cd-8279-d83a9e3859ce tempest-AttachVolumeTestJSON-1299027502 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-9b615afe-46de-4e74-a5b0-323dc7cb0384', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74eadd3f-a2eb-4e2f-88ae-8e8908a43726', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:35:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b7e2415b-6636-4690-9496-10a8d758ad26 req-362ca29d-3991-44cd-8279-d83a9e3859ce tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:35:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-2775c9df-d637-411f-b689-57089fcdc7f8 tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab" returned: 0 in 1.622s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-2775c9df-d637-411f-b689-57089fcdc7f8 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.708s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-2775c9df-d637-411f-b689-57089fcdc7f8 tempest-TaggedBootDevicesTest-901893937 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7908a700-d59d-4a25-9c4a-15688fd1c39a', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:35:32 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-2775c9df-d637-411f-b689-57089fcdc7f8 tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:35:32 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-b7e2415b-6636-4690-9496-10a8d758ad26 req-362ca29d-3991-44cd-8279-d83a9e3859ce tempest-AttachVolumeTestJSON-1299027502 None] attachment_update completed successfully. Sep 18 11:35:32 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-2775c9df-d637-411f-b689-57089fcdc7f8 tempest-TaggedBootDevicesTest-901893937 None] attachment_update completed successfully. Sep 18 11:35:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8482dd93-6d8b-46a2-8b04-8ee8b93c3c1d tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8482dd93-6d8b-46a2-8b04-8ee8b93c3c1d tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:37 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de914d2-ed4c-461a-85a7-617ae41f5ee9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:35:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8482dd93-6d8b-46a2-8b04-8ee8b93c3c1d tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8482dd93-6d8b-46a2-8b04-8ee8b93c3c1d tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f" returned: 0 in 0.978s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8482dd93-6d8b-46a2-8b04-8ee8b93c3c1d tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.098s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8482dd93-6d8b-46a2-8b04-8ee8b93c3c1d tempest-TaggedBootDevicesTest-901893937 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-c9247778-3de3-4db6-bc70-5e526331ea1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6dedac9-734a-4a55-80da-7dfb01c3b1d4', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:35:39 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8482dd93-6d8b-46a2-8b04-8ee8b93c3c1d tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:35:39 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-98b62032-66c2-4d05-9fcf-b19135bbed68 req-8482dd93-6d8b-46a2-8b04-8ee8b93c3c1d tempest-TaggedBootDevicesTest-901893937 None] attachment_update completed successfully. Sep 18 11:35:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Flow 'volume_create_manager' (4237d3b0-62cd-4817-93b3-e075df963ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378b60e0-f981-4bff-b741-a65c0120932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378b60e0-f981-4bff-b741-a65c0120932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1052068736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dca889-29f3-45d9-b24e-55ab282235d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4a37079106431f90a090f4bc4d017a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:35:43Z,use_quota=True,user_id='628a0751924e4cfe98db2496cfbf1ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a1b825-87f6-4e71-99bb-e66cf218d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a1b825-87f6-4e71-99bb-e66cf218d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609471da-5342-4d43-be40-290b9206dbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609471da-5342-4d43-be40-290b9206dbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73dca889-29f3-45d9-b24e-55ab282235d1', 'volume_name': 'volume-73dca889-29f3-45d9-b24e-55ab282235d1', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fc6430-235d-4d2f-8e89-7ef66400e03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fc6430-235d-4d2f-8e89-7ef66400e03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619af9db-5d1e-4be8-bda9-e680c38a3af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:43 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Volume 73dca889-29f3-45d9-b24e-55ab282235d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73dca889-29f3-45d9-b24e-55ab282235d1', 'volume_size': 1} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1052068736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dca889-29f3-45d9-b24e-55ab282235d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4a37079106431f90a090f4bc4d017a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:35:43Z,use_quota=True,user_id='628a0751924e4cfe98db2496cfbf1ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Creating volume 73dca889-29f3-45d9-b24e-55ab282235d1 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:35:43 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:43 devstack quobyte-client[83210]: System call of process 89604 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:35:43 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=14, name=volume-73dca889-29f3-45d9-b24e-55ab282235d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:35:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:35:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1 1073741824" returned: 0 in 0.967s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.938s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:35:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1" returned: 0 in 0.488s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] <== create_volume: return (1608ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:35:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619af9db-5d1e-4be8-bda9-e680c38a3af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73dca889-29f3-45d9-b24e-55ab282235d1', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b418d5-e345-4f9b-a82f-30868a691f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:35:45 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Volume volume-73dca889-29f3-45d9-b24e-55ab282235d1 (73dca889-29f3-45d9-b24e-55ab282235d1): created successfully Sep 18 11:35:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b418d5-e345-4f9b-a82f-30868a691f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:35:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Flow 'volume_create_manager' (4237d3b0-62cd-4817-93b3-e075df963ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:35:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5c3de4ea-1a0b-4302-94dd-e64a822b1a16 tempest-AttachVolumeTestJSON-1299027502 None] Created volume successfully. Sep 18 11:35:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-05dbb883-3859-4f31-ad7c-06d91ed58926 req-84dec3cc-f9d4-42f5-97d1-cf7983428540 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:35:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-05dbb883-3859-4f31-ad7c-06d91ed58926 req-84dec3cc-f9d4-42f5-97d1-cf7983428540 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.023s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:35:54 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d04dfff-9e1f-4e83-ac59-bcfdb8c1f73f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:35:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-05dbb883-3859-4f31-ad7c-06d91ed58926 req-84dec3cc-f9d4-42f5-97d1-cf7983428540 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:35:55 devstack quobyte-client[83210]: System call of process 89660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:35:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-05dbb883-3859-4f31-ad7c-06d91ed58926 req-84dec3cc-f9d4-42f5-97d1-cf7983428540 tempest-AttachVolumeTestJSON-1299027502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1" returned: 0 in 1.111s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:35:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-05dbb883-3859-4f31-ad7c-06d91ed58926 req-84dec3cc-f9d4-42f5-97d1-cf7983428540 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.320s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:35:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-05dbb883-3859-4f31-ad7c-06d91ed58926 req-84dec3cc-f9d4-42f5-97d1-cf7983428540 tempest-AttachVolumeTestJSON-1299027502 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-73dca889-29f3-45d9-b24e-55ab282235d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1915dd40-6171-4a5a-be9a-1eb5313a75ff', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:35:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-05dbb883-3859-4f31-ad7c-06d91ed58926 req-84dec3cc-f9d4-42f5-97d1-cf7983428540 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:35:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-05dbb883-3859-4f31-ad7c-06d91ed58926 req-84dec3cc-f9d4-42f5-97d1-cf7983428540 tempest-AttachVolumeTestJSON-1299027502 None] attachment_update completed successfully. Sep 18 11:36:06 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=12,cinder:DELETE=2,cinder:SELECT=27 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:36:06 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=33,cinder:UPDATE=12 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:36:26 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-47ca8ffd-8375-41ee-9ba4-830534a06bf7 req-6e674472-c122-42ef-a537-7576565582b7 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:36:26 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-47ca8ffd-8375-41ee-9ba4-830534a06bf7 req-6e674472-c122-42ef-a537-7576565582b7 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:36:26 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-47ca8ffd-8375-41ee-9ba4-830534a06bf7 req-6e674472-c122-42ef-a537-7576565582b7 tempest-AttachVolumeTestJSON-1299027502 None] Terminate volume connection completed successfully. Sep 18 11:36:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-47ca8ffd-8375-41ee-9ba4-830534a06bf7 req-6e674472-c122-42ef-a537-7576565582b7 tempest-AttachVolumeTestJSON-1299027502 None] Deleting attachment 74eadd3f-a2eb-4e2f-88ae-8e8908a43726. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:36:36 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:36:36 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:36:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:36:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:36:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:36:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:36:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:36:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:36:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:36:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.157s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:36:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:36:45 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Flow 'volume_create_manager' (390f1c74-edf4-4c9e-9e3e-b1d949b5d52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdc6a8d-c09d-4635-84e6-f1662151f9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdc6a8d-c09d-4635-84e6-f1662151f9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-59745936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd3426b-db56-4785-84a5-fb92a2088fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8194112b18924cc6b50ba8e2fa3d385e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:45Z,use_quota=True,user_id='36f27458c3a0417482b22ee7c5c6d9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef8481c-b084-4864-8c26-e5e60898dc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef8481c-b084-4864-8c26-e5e60898dc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bb91b-f4e8-422a-8907-863ce4b2f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5bb91b-f4e8-422a-8907-863ce4b2f78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd3426b-db56-4785-84a5-fb92a2088fea', 'volume_name': 'volume-1fd3426b-db56-4785-84a5-fb92a2088fea', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2deb201-0ff8-40bd-8456-ea610f76f0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2deb201-0ff8-40bd-8456-ea610f76f0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed463529-b396-4c3c-b805-03f50455389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:36:45 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume 1fd3426b-db56-4785-84a5-fb92a2088fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd3426b-db56-4785-84a5-fb92a2088fea', 'volume_size': 1} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-59745936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd3426b-db56-4785-84a5-fb92a2088fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8194112b18924cc6b50ba8e2fa3d385e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:36:45Z,use_quota=True,user_id='36f27458c3a0417482b22ee7c5c6d9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Creating volume 1fd3426b-db56-4785-84a5-fb92a2088fea {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:36:45 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:36:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:36:46 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=15, name=volume-1fd3426b-db56-4785-84a5-fb92a2088fea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:36:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea 1073741824" returned: 0 in 0.627s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:36:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:36:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea" returned: 0 in 0.157s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:36:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] <== create_volume: return (882ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:36:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:36:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed463529-b396-4c3c-b805-03f50455389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd3426b-db56-4785-84a5-fb92a2088fea', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:36:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2143821-b0f0-473d-a687-e8632655579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:36:47 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume volume-1fd3426b-db56-4785-84a5-fb92a2088fea (1fd3426b-db56-4785-84a5-fb92a2088fea): created successfully Sep 18 11:36:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2143821-b0f0-473d-a687-e8632655579d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:36:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Flow 'volume_create_manager' (390f1c74-edf4-4c9e-9e3e-b1d949b5d52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:36:47 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a6ea624c-a42e-43e1-820a-ae302a846de3 tempest-AttachVolumeShelveTestJSON-442706181 None] Created volume successfully. Sep 18 11:36:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-05718f38-c7fa-45d9-be8c-ce7b5731c647 req-489d9dc0-f8d4-40fe-8cdf-1960fbc6658b tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:36:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-05718f38-c7fa-45d9-be8c-ce7b5731c647 req-489d9dc0-f8d4-40fe-8cdf-1960fbc6658b tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:36:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-05718f38-c7fa-45d9-be8c-ce7b5731c647 req-489d9dc0-f8d4-40fe-8cdf-1960fbc6658b tempest-AttachVolumeTestJSON-1299027502 None] Terminate volume connection completed successfully. Sep 18 11:36:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-05718f38-c7fa-45d9-be8c-ce7b5731c647 req-489d9dc0-f8d4-40fe-8cdf-1960fbc6658b tempest-AttachVolumeTestJSON-1299027502 None] Deleting attachment 1915dd40-6171-4a5a-be9a-1eb5313a75ff. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:36:57 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:37:02 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:37:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "cinder-73dca889-29f3-45d9-b24e-55ab282235d1-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-73dca889-29f3-45d9-b24e-55ab282235d1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:13 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:37:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "cinder-quobyte-73dca889-29f3-45d9-b24e-55ab282235d1" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-quobyte-73dca889-29f3-45d9-b24e-55ab282235d1" acquired by "delete_volume" :: waited 0.038s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:13 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb26e0d3-2eab-4f23-a11e-49c5b443347e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:37:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1" returned: 0 in 1.322s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-73dca889-29f3-45d9-b24e-55ab282235d1" returned: 0 in 0.140s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-quobyte-73dca889-29f3-45d9-b24e-55ab282235d1" released by "delete_volume" :: held 1.759s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Created reservations ['12a7d2ee-5deb-4f38-9873-c7d2c9df3ce2', '3f85e463-c282-4598-adc9-67a3ff7da914', 'bfa0382b-7366-477a-a781-8d2181a285b2', '21a45eba-7f32-47af-8668-40e221e3c8e8'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "cinder-9b615afe-46de-4e74-a5b0-323dc7cb0384-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.509s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-9b615afe-46de-4e74-a5b0-323dc7cb0384-delete_volume" acquired by "delete_volume" :: waited 0.244s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Deleted volume successfully. Sep 18 11:37:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "cinder-quobyte-9b615afe-46de-4e74-a5b0-323dc7cb0384" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0c3386cf-a88f-4f01-a9a1-64d7e01edeee tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-73dca889-29f3-45d9-b24e-55ab282235d1-delete_volume" released by "delete_volume" :: held 3.638s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-quobyte-9b615afe-46de-4e74-a5b0-323dc7cb0384" acquired by "delete_volume" :: waited 0.037s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f4cb71-7094-46de-9e2e-416bc34911cc]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:37:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384" returned: 0 in 0.912s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9b615afe-46de-4e74-a5b0-323dc7cb0384" returned: 0 in 0.153s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-quobyte-9b615afe-46de-4e74-a5b0-323dc7cb0384" released by "delete_volume" :: held 1.224s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Created reservations ['7c3f9ec6-f9cb-4776-a99c-2943307bdcae', '349f1904-04e5-45d7-9603-08bfc51a153f', '99a4f694-635c-4593-81fd-3b3714cf1626', '17885e9f-ddc9-49bf-bf88-9c780f1f5ddc'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.175s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:18 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:37:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Deleted volume successfully. Sep 18 11:37:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "cinder-33fdd437-3c8f-4798-b03d-6dd031f8ec9e-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a226fd4-4104-47d4-a815-b4badbd3e62c tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-9b615afe-46de-4e74-a5b0-323dc7cb0384-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-33fdd437-3c8f-4798-b03d-6dd031f8ec9e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:37:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "cinder-quobyte-33fdd437-3c8f-4798-b03d-6dd031f8ec9e" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-quobyte-33fdd437-3c8f-4798-b03d-6dd031f8ec9e" acquired by "delete_volume" :: waited 0.023s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:19 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f309eee4-fd1d-4078-b1d0-165920efa170]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:37:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e" returned: 0 in 0.565s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33fdd437-3c8f-4798-b03d-6dd031f8ec9e" returned: 0 in 0.153s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-quobyte-33fdd437-3c8f-4798-b03d-6dd031f8ec9e" released by "delete_volume" :: held 1.045s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Created reservations ['5d00a0bc-aaf5-470d-8316-c511851cd16c', 'b4a591de-9dee-4972-8310-4b1560be9087', '1fca7262-b944-4285-b330-0842e5129968', '23161592-725b-4727-a463-a87ac23890ac'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.211s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:21 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:37:21 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Deleted volume successfully. Sep 18 11:37:22 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8d3d163-fa5f-496f-898b-4265a58dac07 tempest-AttachVolumeTestJSON-1299027502 None] Lock "cinder-33fdd437-3c8f-4798-b03d-6dd031f8ec9e-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0a8d3447-bc7b-4e5c-9181-7ab199ec6cac req-42f63815-eccf-4770-aee0-7044bd4062cd tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0a8d3447-bc7b-4e5c-9181-7ab199ec6cac req-42f63815-eccf-4770-aee0-7044bd4062cd tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:23 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8681fbdd-9d47-48a6-b158-2c377af3eb83]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:37:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-0a8d3447-bc7b-4e5c-9181-7ab199ec6cac req-42f63815-eccf-4770-aee0-7044bd4062cd tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-0a8d3447-bc7b-4e5c-9181-7ab199ec6cac req-42f63815-eccf-4770-aee0-7044bd4062cd tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea" returned: 0 in 1.265s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0a8d3447-bc7b-4e5c-9181-7ab199ec6cac req-42f63815-eccf-4770-aee0-7044bd4062cd tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.366s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0a8d3447-bc7b-4e5c-9181-7ab199ec6cac req-42f63815-eccf-4770-aee0-7044bd4062cd tempest-AttachVolumeShelveTestJSON-442706181 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-1fd3426b-db56-4785-84a5-fb92a2088fea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6f8d766-3f35-4f59-acea-491699918464', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:37:24 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-0a8d3447-bc7b-4e5c-9181-7ab199ec6cac req-42f63815-eccf-4770-aee0-7044bd4062cd tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:37:25 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-0a8d3447-bc7b-4e5c-9181-7ab199ec6cac req-42f63815-eccf-4770-aee0-7044bd4062cd tempest-AttachVolumeShelveTestJSON-442706181 None] attachment_update completed successfully. Sep 18 11:37:33 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Flow 'volume_create_manager' (6fa76fbd-21ef-4e6d-b437-e7570265935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111c8dd6-cfbb-4105-9151-20cf07f57544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111c8dd6-cfbb-4105-9151-20cf07f57544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2061727881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5e316b-7cf9-4baf-9575-18b35a52072f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92abcdcfa994e548e7b096a54943561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:37:34Z,use_quota=True,user_id='de0789c760454baa9ceef4e9594f48b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38006ee-0813-4f23-af46-cd81c144afa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38006ee-0813-4f23-af46-cd81c144afa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3eca533-bbdd-4ea2-a83d-d96f9ce8ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3eca533-bbdd-4ea2-a83d-d96f9ce8ab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5e316b-7cf9-4baf-9575-18b35a52072f', 'volume_name': 'volume-aa5e316b-7cf9-4baf-9575-18b35a52072f', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:37:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81f7af8-0ede-48e4-b23c-5b35b983ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81f7af8-0ede-48e4-b23c-5b35b983ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c307a64a-6703-43a6-bd3f-f33c0f575959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:37:34 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Volume aa5e316b-7cf9-4baf-9575-18b35a52072f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5e316b-7cf9-4baf-9575-18b35a52072f', 'volume_size': 1} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2061727881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5e316b-7cf9-4baf-9575-18b35a52072f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d92abcdcfa994e548e7b096a54943561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:37:34Z,use_quota=True,user_id='de0789c760454baa9ceef4e9594f48b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Creating volume aa5e316b-7cf9-4baf-9575-18b35a52072f {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:37:34 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:34 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=16, name=volume-aa5e316b-7cf9-4baf-9575-18b35a52072f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f 1073741824" returned: 0 in 0.462s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f" returned: 0 in 0.140s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] <== create_volume: return (690ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c307a64a-6703-43a6-bd3f-f33c0f575959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5e316b-7cf9-4baf-9575-18b35a52072f', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e023c332-f098-4b04-924d-60f468ca4b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:37:34 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Volume volume-aa5e316b-7cf9-4baf-9575-18b35a52072f (aa5e316b-7cf9-4baf-9575-18b35a52072f): created successfully Sep 18 11:37:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e023c332-f098-4b04-924d-60f468ca4b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:37:35 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Flow 'volume_create_manager' (6fa76fbd-21ef-4e6d-b437-e7570265935e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:37:35 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-b1b7a9db-b9c1-4ed4-85af-3f8d7d81707f req-32486a39-ccc4-474a-ab78-f0a6424f0ab2 tempest-VolumesSnapshotsTestJSON-908833553 None] Created volume successfully. Sep 18 11:37:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:37:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Creating offline snapshot 67ce11f4-3040-41d4-8498-7cb724edf05f of volume aa5e316b-7cf9-4baf-9575-18b35a52072f {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:37:37 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd732be2-11a9-4d1b-99c9-77c0ceddb67c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:37:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:38 devstack quobyte-client[83210]: System call of process 90443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:37:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f" returned: 0 in 0.844s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:38 devstack quobyte-client[83210]: System call of process 90456 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:37:38 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=17, name=volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f 1G" returned: 0 in 0.433s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): qemu-img rebase -u -b volume-aa5e316b-7cf9-4baf-9575-18b35a52072f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "qemu-img rebase -u -b volume-aa5e316b-7cf9-4baf-9575-18b35a52072f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f" returned: 0 in 0.210s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f" returned: 0 in 0.156s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f" returned: 0 in 0.152s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.info" returned: 0 in 0.186s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:37:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.info" returned: 0 in 0.203s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:41 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-98a1e7b9-a376-4b34-8448-e4616c68e3d2 req-c981e687-a140-4388-9b90-c4cc229ae60a tempest-VolumesSnapshotsTestJSON-908833553 None] Create snapshot completed successfully Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "cinder-67ce11f4-3040-41d4-8498-7cb724edf05f-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-67ce11f4-3040-41d4-8498-7cb724edf05f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:42 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "cinder-quobyte-aa5e316b-7cf9-4baf-9575-18b35a52072f" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-quobyte-aa5e316b-7cf9-4baf-9575-18b35a52072f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "cinder-quobyte-67ce11f4-3040-41d4-8498-7cb724edf05f" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-quobyte-67ce11f4-3040-41d4-8498-7cb724edf05f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Deleting offline snapshot 67ce11f4-3040-41d4-8498-7cb724edf05f of volume aa5e316b-7cf9-4baf-9575-18b35a52072f {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] snapshot_file for this snap is: volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b37e02-61ab-4940-b484-150e37a3bec3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:37:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:42 devstack quobyte-client[83210]: System call of process 90479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f" returned: 0 in 0.530s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa5e316b-7cf9-4baf-9575-18b35a52072f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4585658-5bb9-4927-8a3d-2b1a871d3e28]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:43 devstack quobyte-client[83210]: System call of process 90484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:37:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f" returned: 0 in 1.115s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.456s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:37:44 devstack quobyte-client[83210]: System call of process 90494 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:37:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f" returned: 0 in 0.509s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f.67ce11f4-3040-41d4-8498-7cb724edf05f" returned: 0 in 0.175s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-quobyte-67ce11f4-3040-41d4-8498-7cb724edf05f" released by "_delete_snapshot" :: held 2.748s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-quobyte-aa5e316b-7cf9-4baf-9575-18b35a52072f" released by "delete_snapshot" :: held 2.781s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:45 devstack cinder-volume[83184]: WARNING cinder.quota [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:37:45 devstack cinder-volume[83184]: DEBUG cinder.quota [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Created reservations ['12033d0e-de76-4ed2-9aee-c15deff157d6', 'c008487c-37b5-46cd-8ef1-fa241fd33035', '08e9be66-1a50-4f20-a3df-b76c0885fb5f', '36e99012-b91d-4487-b97c-cc14542e6ae9'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:37:46 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Delete snapshot completed successfully. Sep 18 11:37:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-b4012f81-942e-447a-a7ad-40a41ec6f59e req-8e4614cd-d651-4e9d-9af4-fe1c8da65b0c tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-67ce11f4-3040-41d4-8498-7cb724edf05f-delete_snapshot" released by "delete_snapshot" :: held 3.761s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "cinder-aa5e316b-7cf9-4baf-9575-18b35a52072f-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-aa5e316b-7cf9-4baf-9575-18b35a52072f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:47 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:37:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "cinder-quobyte-aa5e316b-7cf9-4baf-9575-18b35a52072f" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:37:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-quobyte-aa5e316b-7cf9-4baf-9575-18b35a52072f" acquired by "delete_volume" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:37:47 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c3aff2-d3f2-45eb-8cf8-c70164e54049]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:37:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f" returned: 0 in 1.363s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aa5e316b-7cf9-4baf-9575-18b35a52072f" returned: 0 in 0.171s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-quobyte-aa5e316b-7cf9-4baf-9575-18b35a52072f" released by "delete_volume" :: held 2.069s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG cinder.quota [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Created reservations ['0de863c0-bfdd-45e8-92c0-6e0053950205', '088c210e-27cb-4c83-bdcd-26e0b1beb798', '8c1a7188-9fa2-41a6-81cd-992a7a8cba1c', '75ba5ab0-8508-4c01-8888-d1b9ad35dae5'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.212s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:37:50 devstack cinder-volume[83184]: DEBUG cinder.manager [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:37:50 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Deleted volume successfully. Sep 18 11:37:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-d83ecea7-e96c-4f3c-b0a4-4bd3a50de709 req-2f5bffc7-4372-4c5c-8eac-7b6bac3cbe72 tempest-VolumesSnapshotsTestJSON-908833553 None] Lock "cinder-aa5e316b-7cf9-4baf-9575-18b35a52072f-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:38:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b96609b0-2d47-4207-8f1a-2d0052fe8e47 tempest-BackendsCapabilitiesAdminTestsJSON-1629155639 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 18 11:38:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1fc98104-3972-4f4c-883a-b1a57470836c tempest-BackendsCapabilitiesAdminTestsJSON-1629155639 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 18 11:38:00 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=32,cinder:INSERT=14,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:38:01 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=47,cinder:SELECT=34,cinder:INSERT=6,cinder:DELETE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:38:15 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ed6e3242-52ca-4e0c-be59-ddc5c71d4fb9 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ed6e3242-52ca-4e0c-be59-ddc5c71d4fb9 tempest-GroupSnapshotsTest-1438263681 None] Group tempest-GroupSnapshotsTest-Group-319346336: creating Sep 18 11:38:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ed6e3242-52ca-4e0c-be59-ddc5c71d4fb9 tempest-GroupSnapshotsTest-1438263681 None] Group tempest-GroupSnapshotsTest-Group-319346336: created successfully Sep 18 11:38:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ed6e3242-52ca-4e0c-be59-ddc5c71d4fb9 tempest-GroupSnapshotsTest-1438263681 None] Create group completed successfully. Sep 18 11:38:18 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Flow 'volume_create_manager' (d9252904-7a70-4067-a4b3-0ecd5dacc19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a82fcdf-6f62-4b87-837d-5bff2f30d46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a82fcdf-6f62-4b87-837d-5bff2f30d46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1044239847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=303131a0-e8b6-48b2-9c42-93eca273bee0,host='devstack@QuobyteHD#QuobyteHD',id=92cce5c9-4ec6-408b-8ace-712cf787f9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4f561671246248aeadc70b7020ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:38:18Z,use_quota=True,user_id='d228f5416c9844fb818b06d7fc0e4960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56984114-2ed7-4178-b60b-11a4a7e78f97),volume_type_id=56984114-2ed7-4178-b60b-11a4a7e78f97)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3041f0f-c4ef-4fa9-89d6-2573cb568586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3041f0f-c4ef-4fa9-89d6-2573cb568586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20de646a-97aa-4a87-84d1-358033f40219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20de646a-97aa-4a87-84d1-358033f40219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92cce5c9-4ec6-408b-8ace-712cf787f9c4', 'volume_name': 'volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9b1af8-daaa-490e-b9bd-66840152ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9b1af8-daaa-490e-b9bd-66840152ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059f37c7-7454-4a28-9c3e-b296b600cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:38:18 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Volume 92cce5c9-4ec6-408b-8ace-712cf787f9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4', 'volume_size': 1} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=303131a0-e8b6-48b2-9c42-93eca273bee0,created_at=2025-09-18T09:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1044239847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=303131a0-e8b6-48b2-9c42-93eca273bee0,host='devstack@QuobyteHD#QuobyteHD',id=92cce5c9-4ec6-408b-8ace-712cf787f9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4f561671246248aeadc70b7020ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:38:18Z,use_quota=True,user_id='d228f5416c9844fb818b06d7fc0e4960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56984114-2ed7-4178-b60b-11a4a7e78f97),volume_type_id=56984114-2ed7-4178-b60b-11a4a7e78f97)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Creating volume 92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:38:18 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:18 devstack quobyte-client[83210]: System call of process 90648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:38:18 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=19, name=volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 1073741824" returned: 0 in 0.467s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4" returned: 0 in 0.149s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] <== create_volume: return (697ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:38:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:38:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059f37c7-7454-4a28-9c3e-b296b600cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:38:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3597f9b5-4438-4028-8fe9-c0ed349890f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:38:19 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Volume volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 (92cce5c9-4ec6-408b-8ace-712cf787f9c4): created successfully Sep 18 11:38:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3597f9b5-4438-4028-8fe9-c0ed349890f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:38:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Flow 'volume_create_manager' (d9252904-7a70-4067-a4b3-0ecd5dacc19b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:38:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f87cc863-2d95-47a3-aa00-1329b3cd2883 tempest-GroupSnapshotsTest-1438263681 None] Created volume successfully. Sep 18 11:38:20 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] GroupSnapshot e08323f6-6a4e-4c8a-b86f-ae5e9645b666: creating. Sep 18 11:38:21 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Group snapshot e08323f6-6a4e-4c8a-b86f-ae5e9645b666: creating. {{(pid=83184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 18 11:38:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:38:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:38:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Creating offline snapshot 9d8b76e3-1def-48ec-9397-8b11967377a1 of volume 92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:38:21 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e73437e-1e9b-4827-872a-d7b4375dbcb4]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:38:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4" returned: 0 in 0.565s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:22 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=20, name=volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:38:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 1G" returned: 0 in 1.446s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img rebase -u -b volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img rebase -u -b volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1" returned: 0 in 2.057s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:38:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1" returned: 0 in 0.656s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:38:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1" returned: 0 in 1.093s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.info" returned: 0 in 0.406s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:38:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.info" returned: 0 in 0.606s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.130s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:38:31 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:38:31 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:38:32 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-70934bf7-dfde-4801-b44c-1f8d8b7e823a tempest-GroupSnapshotsTest-1438263681 None] group_snapshot e08323f6-6a4e-4c8a-b86f-ae5e9645b666: created successfully Sep 18 11:38:36 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-9d8b76e3-1def-48ec-9397-8b11967377a1-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" by "_create_volume_from_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-9d8b76e3-1def-48ec-9397-8b11967377a1-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Creating volume 4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30 from snapshot 9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" by "_copy_volume_from_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] snapshot: 9d8b76e3-1def-48ec-9397-8b11967377a1, volume: 4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30, {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ee222-555a-4583-87f8-4b6943fab992]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:38:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:37 devstack quobyte-client[83210]: System call of process 91001 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:38:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1" returned: 0 in 1.016s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:38:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 18 11:38:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Creating direct copy from snapshot {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 18 11:38:38 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d2d921-ed66-4c5b-bf34-1c7424a3a0c4]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:38:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4" returned: 0 in 0.868s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:39 devstack cinder-volume[83184]: DEBUG cinder.utils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30 not found in is_blk_device check {{(pid=83184) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 18 11:38:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:39 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=22, name=volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:38:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:38:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:38:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.041s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:38:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:38:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:38:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.161s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:38:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.853s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:38:46 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:38:46 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:38:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" returned: 0 in 10.644s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:49 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6aec8c-d0ba-44c7-82c4-558c6670f6fc]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:38:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:51 devstack quobyte-client[83210]: System call of process 91048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:38:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4" returned: 0 in 1.782s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:51 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Image conversion details: src /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4, size 1024.00 MB, duration 10.65 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30 {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 11:38:51 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Converted 1024.00 MB image at 96.17 MB/s Sep 18 11:38:51 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:38:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" returned: 0 in 0.157s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" released by "_copy_volume_from_snapshot" :: held 15.262s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:38:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-9d8b76e3-1def-48ec-9397-8b11967377a1-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" released by "_create_volume_from_snapshot" :: held 15.381s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:38:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.495s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:38:53 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-8e94d408-ac33-4b43-9e11-72af27294e2e tempest-GroupSnapshotsTest-1438263681 None] Create group from source-snapshot-e08323f6-6a4e-4c8a-b86f-ae5e9645b666 completed successfully. Sep 18 11:38:54 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:38:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" acquired by "delete_volume" :: waited 0.082s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:38:54 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f803d7a-09e4-439c-b713-3cef21b3f8ea]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:38:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" returned: 0 in 0.793s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" returned: 0 in 0.213s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:55 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-4a90f1f8-fc0d-4ccd-b9b9-0f0d31cd7f30" released by "delete_volume" :: held 1.307s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:38:55 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['c34e9d65-93da-41d9-aa96-e661cf6f0633'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:38:56 devstack cinder-volume[83184]: WARNING cinder.quota [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-375075411 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-375075411, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:38:56 devstack cinder-volume[83184]: WARNING cinder.quota [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-375075411 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-375075411, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:38:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-e350c12b-5286-4d3c-ba3e-6503b3a54f8b tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['cafc268b-17c0-4db8-894a-a7665161f281', '1f4e5350-18f5-45ae-8d29-46bc13339b15', '8eeaa3f6-d7e5-44de-80a8-a30f9b3673b8', 'a3b2cb38-a01b-48c4-9bc8-a9108687f68c'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:38:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-e350c12b-5286-4d3c-ba3e-6503b3a54f8b tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-e350c12b-5286-4d3c-ba3e-6503b3a54f8b tempest-TaggedBootDevicesTest-901893937 None] Terminate volume connection completed successfully. Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-e350c12b-5286-4d3c-ba3e-6503b3a54f8b tempest-TaggedBootDevicesTest-901893937 None] Deleting attachment 547abff9-02e3-4a4a-8155-15cdf15d6e01. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.175s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:56 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:38:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-96baa048-a7c0-4d29-8125-ed2a72f2e7e7 tempest-GroupSnapshotsTest-1438263681 None] Delete group completed successfully. Sep 18 11:38:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] group_snapshot e08323f6-6a4e-4c8a-b86f-ae5e9645b666: deleting Sep 18 11:38:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-70d91a44-894f-46b8-943d-01fffa901aa4 tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-70d91a44-894f-46b8-943d-01fffa901aa4 tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-70d91a44-894f-46b8-943d-01fffa901aa4 tempest-TaggedBootDevicesTest-901893937 None] Terminate volume connection completed successfully. Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-70d91a44-894f-46b8-943d-01fffa901aa4 tempest-TaggedBootDevicesTest-901893937 None] Deleting attachment 7908a700-d59d-4a25-9c4a-15688fd1c39a. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:38:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] group_snapshot e08323f6-6a4e-4c8a-b86f-ae5e9645b666: deleting {{(pid=83184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-92cce5c9-4ec6-408b-8ace-712cf787f9c4" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-92cce5c9-4ec6-408b-8ace-712cf787f9c4" acquired by "delete_snapshot" :: waited 0.104s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-9d8b76e3-1def-48ec-9397-8b11967377a1" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-9d8b76e3-1def-48ec-9397-8b11967377a1" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Deleting offline snapshot 9d8b76e3-1def-48ec-9397-8b11967377a1 of volume 92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] snapshot_file for this snap is: volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ab31c-1b44-4433-8059-d73309f68b90]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:38:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-93b5bce3-bd60-41b8-89e6-21d41ece424b tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:58 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-93b5bce3-bd60-41b8-89e6-21d41ece424b tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:38:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-93b5bce3-bd60-41b8-89e6-21d41ece424b tempest-TaggedBootDevicesTest-901893937 None] Terminate volume connection completed successfully. Sep 18 11:38:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b30d811e-ad29-4eb0-91ed-2d5ece29de3f req-93b5bce3-bd60-41b8-89e6-21d41ece424b tempest-TaggedBootDevicesTest-901893937 None] Deleting attachment d6dedac9-734a-4a55-80da-7dfb01c3b1d4. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:38:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1" returned: 0 in 0.659s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:38:58 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa30463a-9afd-4aa2-a896-4e79d0d64d3b]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:38:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4" returned: 0 in 0.514s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1" returned: 0 in 0.216s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:38:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4.9d8b76e3-1def-48ec-9397-8b11967377a1" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:38:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-9d8b76e3-1def-48ec-9397-8b11967377a1" released by "_delete_snapshot" :: held 1.798s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:38:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-92cce5c9-4ec6-408b-8ace-712cf787f9c4" released by "delete_snapshot" :: held 1.882s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:38:59 devstack cinder-volume[83184]: WARNING cinder.quota [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-375075411 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-375075411, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:38:59 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['fa5f3ead-e5a9-4c60-96b3-d77acc4c36fe', '60bb6a29-eb7e-49da-80aa-597094304552', '04a4d7f8-1202-46f1-ac63-69d80ffb5682', '553d04d6-0e4c-4f12-aab9-1ff5736b4871'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:38:59 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f58ecc81-270c-4014-8b74-fbf1913366ee tempest-GroupSnapshotsTest-1438263681 None] group_snapshot e08323f6-6a4e-4c8a-b86f-ae5e9645b666: deleted successfully Sep 18 11:39:00 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-92cce5c9-4ec6-408b-8ace-712cf787f9c4" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-92cce5c9-4ec6-408b-8ace-712cf787f9c4" acquired by "delete_volume" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:00 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06592e0-a815-40fc-a472-e9b25eb62889]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4" returned: 0 in 0.470s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-92cce5c9-4ec6-408b-8ace-712cf787f9c4" returned: 0 in 0.126s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-92cce5c9-4ec6-408b-8ace-712cf787f9c4" released by "delete_volume" :: held 0.783s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:01 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['69e9fa5d-e0a4-4640-bca6-915047002b67'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:01 devstack cinder-volume[83184]: WARNING cinder.db.sqlalchemy.api [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-375075411'] Sep 18 11:39:01 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['b1ea9cd5-a5cb-4f7e-8ec6-db3f9e45bbd3', '847d2a74-9333-405e-bd71-553822997e51', '85e9258a-e2b4-4444-9385-265b1e3b7db1', 'cafbc9ff-d9e2-417b-9ec3-0010dde7877f'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.121s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:02 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:39:02 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6a8218fd-6f57-4415-832f-75e3b149189d tempest-GroupSnapshotsTest-1438263681 None] Delete group completed successfully. Sep 18 11:39:04 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-6803a6b8-ccd8-4058-bcba-f958fb01736e tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6803a6b8-ccd8-4058-bcba-f958fb01736e tempest-GroupSnapshotsTest-1438263681 None] Group tempest-GroupSnapshotsTest-Group-508190081: creating Sep 18 11:39:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6803a6b8-ccd8-4058-bcba-f958fb01736e tempest-GroupSnapshotsTest-1438263681 None] Group tempest-GroupSnapshotsTest-Group-508190081: created successfully Sep 18 11:39:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6803a6b8-ccd8-4058-bcba-f958fb01736e tempest-GroupSnapshotsTest-1438263681 None] Create group completed successfully. Sep 18 11:39:06 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Flow 'volume_create_manager' (a5ed9e26-f10e-4f4c-8ff9-867c4c3897f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7133c6-26a2-4792-9cc6-e8342369c5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7133c6-26a2-4792-9cc6-e8342369c5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1315112599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ccbe5ca-f1ec-4e2b-aba2-b673be9d1b7a,host='devstack@QuobyteHD#QuobyteHD',id=04a6f031-1dbe-44d6-9db0-44c850f56d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4f561671246248aeadc70b7020ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:06Z,use_quota=True,user_id='d228f5416c9844fb818b06d7fc0e4960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afbd2cbd-443a-44e9-94dc-93de6529c3eb),volume_type_id=afbd2cbd-443a-44e9-94dc-93de6529c3eb)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda214b3-f2d0-4265-8d04-1cc7ed639311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda214b3-f2d0-4265-8d04-1cc7ed639311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d59369e-fbc5-4bb3-8d4f-a3c96fc3bab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d59369e-fbc5-4bb3-8d4f-a3c96fc3bab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a6f031-1dbe-44d6-9db0-44c850f56d84', 'volume_name': 'volume-04a6f031-1dbe-44d6-9db0-44c850f56d84', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6305f94d-a890-44b8-865a-831eb6e8c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6305f94d-a890-44b8-865a-831eb6e8c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c088865e-5a1f-4041-989a-9c368996f4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:06 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Volume 04a6f031-1dbe-44d6-9db0-44c850f56d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a6f031-1dbe-44d6-9db0-44c850f56d84', 'volume_size': 1} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ccbe5ca-f1ec-4e2b-aba2-b673be9d1b7a,created_at=2025-09-18T09:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1315112599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ccbe5ca-f1ec-4e2b-aba2-b673be9d1b7a,host='devstack@QuobyteHD#QuobyteHD',id=04a6f031-1dbe-44d6-9db0-44c850f56d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4f561671246248aeadc70b7020ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:06Z,use_quota=True,user_id='d228f5416c9844fb818b06d7fc0e4960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afbd2cbd-443a-44e9-94dc-93de6529c3eb),volume_type_id=afbd2cbd-443a-44e9-94dc-93de6529c3eb)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Creating volume 04a6f031-1dbe-44d6-9db0-44c850f56d84 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:39:06 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:39:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:06 devstack quobyte-client[83210]: System call of process 91088 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:39:06 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=23, name=volume-04a6f031-1dbe-44d6-9db0-44c850f56d84, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 1073741824" returned: 0 in 0.543s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84" returned: 0 in 0.189s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] <== create_volume: return (881ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c088865e-5a1f-4041-989a-9c368996f4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a6f031-1dbe-44d6-9db0-44c850f56d84', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af36ba85-b6a8-41aa-81ad-6c369d8bb4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:07 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Volume volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 (04a6f031-1dbe-44d6-9db0-44c850f56d84): created successfully Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af36ba85-b6a8-41aa-81ad-6c369d8bb4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Flow 'volume_create_manager' (a5ed9e26-f10e-4f4c-8ff9-867c4c3897f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:39:07 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-11f1457a-86a9-4400-812b-da8ce3b12224 tempest-GroupSnapshotsTest-1438263681 None] Created volume successfully. Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "cinder-c9247778-3de3-4db6-bc70-5e526331ea1f-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-c9247778-3de3-4db6-bc70-5e526331ea1f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:09 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Flow 'volume_create_manager' (9e56c0b5-8f1a-4138-a2ca-1e9016f6123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01122cbf-69ca-41cf-9776-72bd26154732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01122cbf-69ca-41cf-9776-72bd26154732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-822976512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ccbe5ca-f1ec-4e2b-aba2-b673be9d1b7a,host='devstack@QuobyteHD#QuobyteHD',id=5c2ddb3d-929b-4967-aeb6-ea0c92350555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4f561671246248aeadc70b7020ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:09Z,use_quota=True,user_id='d228f5416c9844fb818b06d7fc0e4960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afbd2cbd-443a-44e9-94dc-93de6529c3eb),volume_type_id=afbd2cbd-443a-44e9-94dc-93de6529c3eb)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (178025ee-18e6-4ea8-8f99-73355a2168e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (178025ee-18e6-4ea8-8f99-73355a2168e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860f59fc-55bf-4c00-a0b5-1c90eeb7d834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860f59fc-55bf-4c00-a0b5-1c90eeb7d834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2ddb3d-929b-4967-aeb6-ea0c92350555', 'volume_name': 'volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3264fceb-8193-4a1e-aac3-d9ee0dd97fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3264fceb-8193-4a1e-aac3-d9ee0dd97fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d37027-7644-4c06-8009-950cadb08dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:09 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Volume 5c2ddb3d-929b-4967-aeb6-ea0c92350555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555', 'volume_size': 1} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ccbe5ca-f1ec-4e2b-aba2-b673be9d1b7a,created_at=2025-09-18T09:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-822976512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ccbe5ca-f1ec-4e2b-aba2-b673be9d1b7a,host='devstack@QuobyteHD#QuobyteHD',id=5c2ddb3d-929b-4967-aeb6-ea0c92350555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4f561671246248aeadc70b7020ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:09Z,use_quota=True,user_id='d228f5416c9844fb818b06d7fc0e4960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afbd2cbd-443a-44e9-94dc-93de6529c3eb),volume_type_id=afbd2cbd-443a-44e9-94dc-93de6529c3eb)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Creating volume 5c2ddb3d-929b-4967-aeb6-ea0c92350555 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:39:09 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:39:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:10 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=24, name=volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:39:10 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "cinder-quobyte-c9247778-3de3-4db6-bc70-5e526331ea1f" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 1073741824" returned: 0 in 0.557s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555" returned: 0 in 0.213s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] <== create_volume: return (859ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-quobyte-c9247778-3de3-4db6-bc70-5e526331ea1f" acquired by "delete_volume" :: waited 0.519s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d37027-7644-4c06-8009-950cadb08dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2635a92-e5e4-4dc6-986b-9f4d3d831a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:10 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dce170-c74b-44d0-8b45-267101e31d02]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:11 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Volume volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 (5c2ddb3d-929b-4967-aeb6-ea0c92350555): created successfully Sep 18 11:39:11 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2635a92-e5e4-4dc6-986b-9f4d3d831a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:11 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Flow 'volume_create_manager' (9e56c0b5-8f1a-4138-a2ca-1e9016f6123b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:39:11 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b70b6be8-b37a-4ace-96da-bc2a71f81f45 tempest-GroupSnapshotsTest-1438263681 None] Created volume successfully. Sep 18 11:39:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f" returned: 0 in 0.642s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9247778-3de3-4db6-bc70-5e526331ea1f" returned: 0 in 0.132s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-quobyte-c9247778-3de3-4db6-bc70-5e526331ea1f" released by "delete_volume" :: held 1.101s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:12 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f7c147b6-0221-427f-8677-216ee96d2575 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:12 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f7c147b6-0221-427f-8677-216ee96d2575 tempest-GroupSnapshotsTest-1438263681 None] Update group completed successfully. Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Created reservations ['2b08d877-6bc3-43b7-a5f8-b1a59fdc3328', '90c08286-d618-4652-b6d1-783fce1e88df', '8732f471-6c5a-463a-89fb-69ebb553c607', '509b38c9-9274-49f3-86e4-8a6319ac149b'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.132s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:12 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:39:12 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Deleted volume successfully. Sep 18 11:39:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18c41df7-a735-4c4e-b21a-c3babab37099 tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-c9247778-3de3-4db6-bc70-5e526331ea1f-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "cinder-2ec822d0-05d0-4d94-9918-cb5927ec95ab-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-2ec822d0-05d0-4d94-9918-cb5927ec95ab-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:13 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-03ae99ca-cf19-4025-85e7-fbc83d75fa34 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:13 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "cinder-quobyte-2ec822d0-05d0-4d94-9918-cb5927ec95ab" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-quobyte-2ec822d0-05d0-4d94-9918-cb5927ec95ab" acquired by "delete_volume" :: waited 0.024s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:13 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-03ae99ca-cf19-4025-85e7-fbc83d75fa34 tempest-GroupSnapshotsTest-1438263681 None] Update group completed successfully. Sep 18 11:39:13 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ab02f-5562-4370-b1c1-c0c59639e182]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab" returned: 0 in 0.453s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2ec822d0-05d0-4d94-9918-cb5927ec95ab" returned: 0 in 0.095s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-quobyte-2ec822d0-05d0-4d94-9918-cb5927ec95ab" released by "delete_volume" :: held 0.743s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:14 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-40e3211d-e76f-4d5f-a30f-5b276fa553bc tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:14 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Created reservations ['39e17d1e-bca1-4c13-8267-2159e578cc3b', '53fec3e5-63f5-43d1-8eb1-75641b39c40c', '0141b4a6-c442-4824-b73b-6cf30b51b0dd', '030daad5-3337-4c74-8e54-4096aad4f350'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-40e3211d-e76f-4d5f-a30f-5b276fa553bc tempest-GroupSnapshotsTest-1438263681 None] Update group completed successfully. Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.112s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:39:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Deleted volume successfully. Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-adf278ab-0447-4f5c-baa2-9e9a5d15c10a tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-2ec822d0-05d0-4d94-9918-cb5927ec95ab-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "cinder-abe97f67-9145-4811-8302-b00fb30ebab9-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-abe97f67-9145-4811-8302-b00fb30ebab9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-988e39e8-6d35-441b-8cb1-c0932877d9bc tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "cinder-quobyte-abe97f67-9145-4811-8302-b00fb30ebab9" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-quobyte-abe97f67-9145-4811-8302-b00fb30ebab9" acquired by "delete_volume" :: waited 0.019s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-988e39e8-6d35-441b-8cb1-c0932877d9bc tempest-GroupSnapshotsTest-1438263681 None] Update group completed successfully. Sep 18 11:39:16 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e453dc4-5de1-4e13-aabc-fda7dfe4ec45]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 0 in 0.435s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 1 in 0.377s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:39:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-abe97f67-9145-4811-8302-b00fb30ebab9" returned: 0 in 0.280s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-quobyte-abe97f67-9145-4811-8302-b00fb30ebab9" released by "delete_volume" :: held 1.529s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:18 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] GroupSnapshot 46e97780-a34a-41a6-9ba9-46c32cbbfd23: creating. Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Created reservations ['5178909f-c320-4a56-bd91-2bb645784f8c', '7b0c6bec-87b8-442b-b614-99c7be596e53', '17e61007-485f-4dac-b329-476a365838cb', '6a3927c2-92d1-41e6-9f78-b42843dfb8d4'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:18 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Group snapshot 46e97780-a34a-41a6-9ba9-46c32cbbfd23: creating. {{(pid=83184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.017s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Creating offline snapshot 01138ce0-4090-4803-86b1-fc850dde6e39 of volume 04a6f031-1dbe-44d6-9db0-44c850f56d84 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d2ec14-b694-44f8-968a-72fa13ea33a3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.207s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:19 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:39:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Deleted volume successfully. Sep 18 11:39:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84" returned: 0 in 1.059s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:19 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=25, name=volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:39:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8621b4e-29fa-42d9-bac9-649f8e34407d tempest-TaggedBootDevicesTest-901893937 None] Lock "cinder-abe97f67-9145-4811-8302-b00fb30ebab9-delete_volume" released by "delete_volume" :: held 3.870s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 1G" returned: 0 in 0.374s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img rebase -u -b volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:20 devstack quobyte-client[83210]: System call of process 91174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:39:20 devstack quobyte-client[83210]: System call of process 91174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:39:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img rebase -u -b volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39" returned: 0 in 0.266s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:39:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39" returned: 0 in 0.215s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:39:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39" returned: 0 in 0.182s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.info" returned: 0 in 0.208s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.info" returned: 0 in 0.250s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.105s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Creating offline snapshot 1b4937eb-39ec-47da-ac6a-a2e1f7b5924e of volume 5c2ddb3d-929b-4967-aeb6-ea0c92350555 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ebe1a3-e72e-43c0-9648-96c9f5fe2856]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:22 devstack quobyte-client[83210]: System call of process 91181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:39:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555" returned: 0 in 0.582s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:22 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=27, name=volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:39:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e 1G" returned: 0 in 0.484s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:23 devstack quobyte-client[83210]: System call of process 91189 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:39:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img rebase -u -b volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" returned: 0 in 0.538s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:39:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" returned: 0 in 0.223s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" returned: 0 in 0.166s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.info" returned: 0 in 0.146s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.info" returned: 0 in 0.145s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.311s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:25 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3969aa3f-fe5c-4087-b944-f232a51ebdab tempest-GroupSnapshotsTest-1438263681 None] group_snapshot 46e97780-a34a-41a6-9ba9-46c32cbbfd23: created successfully Sep 18 11:39:26 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] group_snapshot 46e97780-a34a-41a6-9ba9-46c32cbbfd23: deleting Sep 18 11:39:26 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] group_snapshot 46e97780-a34a-41a6-9ba9-46c32cbbfd23: deleting {{(pid=83184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-04a6f031-1dbe-44d6-9db0-44c850f56d84" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-04a6f031-1dbe-44d6-9db0-44c850f56d84" acquired by "delete_snapshot" :: waited 0.101s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-01138ce0-4090-4803-86b1-fc850dde6e39" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-01138ce0-4090-4803-86b1-fc850dde6e39" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Deleting offline snapshot 01138ce0-4090-4803-86b1-fc850dde6e39 of volume 04a6f031-1dbe-44d6-9db0-44c850f56d84 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] snapshot_file for this snap is: volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e51ddf-a8be-425b-967a-8cd27243e09e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39" returned: 0 in 0.576s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04a6f031-1dbe-44d6-9db0-44c850f56d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:39:27 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ecc5ff-8a25-4120-bc1c-a1d694ec99bc]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84" returned: 0 in 0.516s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39" returned: 0 in 0.268s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84.01138ce0-4090-4803-86b1-fc850dde6e39" returned: 0 in 0.114s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-01138ce0-4090-4803-86b1-fc850dde6e39" released by "_delete_snapshot" :: held 1.847s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-04a6f031-1dbe-44d6-9db0-44c850f56d84" released by "delete_snapshot" :: held 1.884s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-5c2ddb3d-929b-4967-aeb6-ea0c92350555" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-5c2ddb3d-929b-4967-aeb6-ea0c92350555" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Deleting offline snapshot 1b4937eb-39ec-47da-ac6a-a2e1f7b5924e of volume 5c2ddb3d-929b-4967-aeb6-ea0c92350555 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] snapshot_file for this snap is: volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d933ddf-663e-4762-bd94-d499784913ec]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" returned: 0 in 0.437s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:39:29 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5743f7-a678-4f1d-8e22-9e4fb1b70ec0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555" returned: 0 in 0.491s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" returned: 0 in 0.268s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555.1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" returned: 0 in 0.108s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-1b4937eb-39ec-47da-ac6a-a2e1f7b5924e" released by "_delete_snapshot" :: held 1.632s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-5c2ddb3d-929b-4967-aeb6-ea0c92350555" released by "delete_snapshot" :: held 1.662s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:30 devstack cinder-volume[83184]: WARNING cinder.quota [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-269923822 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-269923822, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:39:30 devstack cinder-volume[83184]: WARNING cinder.quota [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-269923822 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-269923822, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:39:31 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['61018215-9894-4258-9c8d-03e028336687', '4559cd88-5178-417f-a472-8f577a826a02', '13b9c38b-5355-4ad0-b6b9-6050c8dfdc87', '2072f698-3e8a-455d-b7f6-1d71744f7330'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:31 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['27b4ec35-3a35-404b-97e2-cbce441db819', 'bf0918a5-e6c7-421b-9ab2-6b69f0bb6923', 'f718c28a-c61e-41e3-8e88-9ff65cc5eb9c', '338bd242-e55b-4a64-90fe-2c217dc435ae'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:31 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-18a53f67-ae41-4bc3-98b9-1b3bbf18296a tempest-GroupSnapshotsTest-1438263681 None] group_snapshot 46e97780-a34a-41a6-9ba9-46c32cbbfd23: deleted successfully Sep 18 11:39:32 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-04a6f031-1dbe-44d6-9db0-44c850f56d84" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-04a6f031-1dbe-44d6-9db0-44c850f56d84" acquired by "delete_volume" :: waited 0.041s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:32 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[79044467-9894-425a-bc4e-9a832e36a846]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84" returned: 0 in 0.676s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-04a6f031-1dbe-44d6-9db0-44c850f56d84" returned: 0 in 0.101s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-04a6f031-1dbe-44d6-9db0-44c850f56d84" released by "delete_volume" :: held 0.999s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-5c2ddb3d-929b-4967-aeb6-ea0c92350555" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-5c2ddb3d-929b-4967-aeb6-ea0c92350555" acquired by "delete_volume" :: waited 0.037s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:33 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ab47ca-6a63-4afd-9d20-04a7efb3bf46]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555" returned: 0 in 0.543s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5c2ddb3d-929b-4967-aeb6-ea0c92350555" returned: 0 in 0.143s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-5c2ddb3d-929b-4967-aeb6-ea0c92350555" released by "delete_volume" :: held 0.877s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['434b23df-7b96-47b4-997f-95822864fbdb'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:35 devstack cinder-volume[83184]: WARNING cinder.quota [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-269923822 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-269923822, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['301d89a0-c0c8-4318-a98c-1f03413b1390', 'b579f9c8-9b81-4df1-9907-516d57ef8ae5', 'e64cb968-6b42-44ba-a93f-f33a9fe16370', 'f03e741d-4b76-4cf0-a9e3-3988b4ef5795'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['9ab8e3d4-8b57-41dd-af25-351a122825c9', '5edb3626-053f-4376-9244-b1a5e9a8dd4f', 'f629fe50-9546-48d2-9e5f-9daed60abbb6', '21411817-2830-4eae-bdd7-800d8665315f'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.103s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:35 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:39:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-c54eff00-06da-4257-a4e4-e47625248c7a tempest-GroupSnapshotsTest-1438263681 None] Delete group completed successfully. Sep 18 11:39:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-47aa968f-8f73-4de3-b5cd-40fc7dad5f78 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:37 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-47aa968f-8f73-4de3-b5cd-40fc7dad5f78 tempest-GroupSnapshotsTest-1438263681 None] Group tempest-GroupSnapshotsTest-Group-451786406: creating Sep 18 11:39:37 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-47aa968f-8f73-4de3-b5cd-40fc7dad5f78 tempest-GroupSnapshotsTest-1438263681 None] Group tempest-GroupSnapshotsTest-Group-451786406: created successfully Sep 18 11:39:37 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-47aa968f-8f73-4de3-b5cd-40fc7dad5f78 tempest-GroupSnapshotsTest-1438263681 None] Create group completed successfully. Sep 18 11:39:38 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Flow 'volume_create_manager' (d5fbe975-cd18-429b-b533-f4af463d76f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61cafa9-f682-49d3-8853-75a835699b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61cafa9-f682-49d3-8853-75a835699b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567297479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e5d29b8-cd96-4f59-8206-2bc71f62acdc,host='devstack@QuobyteHD#QuobyteHD',id=6c449488-40f8-40fe-8f84-1b315eafb7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4f561671246248aeadc70b7020ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:39Z,use_quota=True,user_id='d228f5416c9844fb818b06d7fc0e4960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4709a58e-2b44-4716-9b1d-40dc0cfa54c6),volume_type_id=4709a58e-2b44-4716-9b1d-40dc0cfa54c6)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df582913-4e6c-4f1e-90b8-4e0fc0046ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df582913-4e6c-4f1e-90b8-4e0fc0046ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95f41b5-62a6-412a-ae38-db06db6c97e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95f41b5-62a6-412a-ae38-db06db6c97e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c449488-40f8-40fe-8f84-1b315eafb7ac', 'volume_name': 'volume-6c449488-40f8-40fe-8f84-1b315eafb7ac', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3857d39d-a987-4b6e-94ba-873302377c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3857d39d-a987-4b6e-94ba-873302377c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e145a7ce-158c-4a26-9550-c31f3ce72ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:38 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Volume 6c449488-40f8-40fe-8f84-1b315eafb7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c449488-40f8-40fe-8f84-1b315eafb7ac', 'volume_size': 1} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e5d29b8-cd96-4f59-8206-2bc71f62acdc,created_at=2025-09-18T09:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567297479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e5d29b8-cd96-4f59-8206-2bc71f62acdc,host='devstack@QuobyteHD#QuobyteHD',id=6c449488-40f8-40fe-8f84-1b315eafb7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f4f561671246248aeadc70b7020ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:39:39Z,use_quota=True,user_id='d228f5416c9844fb818b06d7fc0e4960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4709a58e-2b44-4716-9b1d-40dc0cfa54c6),volume_type_id=4709a58e-2b44-4716-9b1d-40dc0cfa54c6)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Creating volume 6c449488-40f8-40fe-8f84-1b315eafb7ac {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:39:38 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:39:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:39 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=29, name=volume-6c449488-40f8-40fe-8f84-1b315eafb7ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:39:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac 1073741824" returned: 0 in 0.577s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac" returned: 0 in 0.089s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] <== create_volume: return (742ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:39:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e145a7ce-158c-4a26-9550-c31f3ce72ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c449488-40f8-40fe-8f84-1b315eafb7ac', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc8269e-a17f-4c4a-a970-646ad8567aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:39:40 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Volume volume-6c449488-40f8-40fe-8f84-1b315eafb7ac (6c449488-40f8-40fe-8f84-1b315eafb7ac): created successfully Sep 18 11:39:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc8269e-a17f-4c4a-a970-646ad8567aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:39:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Flow 'volume_create_manager' (d5fbe975-cd18-429b-b533-f4af463d76f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:39:40 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2db97774-844c-4598-a7e3-0ef6022b9954 tempest-GroupSnapshotsTest-1438263681 None] Created volume successfully. Sep 18 11:39:41 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] GroupSnapshot 4f690c57-c4b2-4147-b029-6014956fbe7d: creating. Sep 18 11:39:41 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Group snapshot 4f690c57-c4b2-4147-b029-6014956fbe7d: creating. {{(pid=83184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 18 11:39:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Creating offline snapshot 995e0b82-f413-48d6-ae5b-d60e58c264fd of volume 6c449488-40f8-40fe-8f84-1b315eafb7ac {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:39:41 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6ed5fd-c186-46ad-b067-ab17a9d185fb]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac" returned: 0 in 0.532s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:42 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=30, name=volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd 1G" returned: 0 in 0.310s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6c449488-40f8-40fe-8f84-1b315eafb7ac -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:42 devstack quobyte-client[83210]: System call of process 91244 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img rebase -u -b volume-6c449488-40f8-40fe-8f84-1b315eafb7ac -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd" returned: 0 in 0.184s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd" returned: 0 in 0.106s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:39:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd" returned: 0 in 0.114s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.info" returned: 0 in 0.111s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.info" returned: 0 in 0.109s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-83a8b132-a45e-4701-8e82-0a1c6938f324 tempest-GroupSnapshotsTest-1438263681 None] group_snapshot 4f690c57-c4b2-4147-b029-6014956fbe7d: created successfully Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.099s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:39:44 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-e5ac7f4b-be6b-4bed-a1ab-bd29b3bb94e4 req-d1ec8a45-41b4-410f-aa01-504565617ed2 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:44 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-e5ac7f4b-be6b-4bed-a1ab-bd29b3bb94e4 req-d1ec8a45-41b4-410f-aa01-504565617ed2 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:44 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-e5ac7f4b-be6b-4bed-a1ab-bd29b3bb94e4 req-d1ec8a45-41b4-410f-aa01-504565617ed2 tempest-AttachVolumeShelveTestJSON-442706181 None] Terminate volume connection completed successfully. Sep 18 11:39:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-e5ac7f4b-be6b-4bed-a1ab-bd29b3bb94e4 req-d1ec8a45-41b4-410f-aa01-504565617ed2 tempest-AttachVolumeShelveTestJSON-442706181 None] Deleting attachment a6f8d766-3f35-4f59-acea-491699918464. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:39:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] group_snapshot 4f690c57-c4b2-4147-b029-6014956fbe7d: deleting Sep 18 11:39:45 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] group_snapshot 4f690c57-c4b2-4147-b029-6014956fbe7d: deleting {{(pid=83184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-6c449488-40f8-40fe-8f84-1b315eafb7ac" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-6c449488-40f8-40fe-8f84-1b315eafb7ac" acquired by "delete_snapshot" :: waited 0.064s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-995e0b82-f413-48d6-ae5b-d60e58c264fd" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-995e0b82-f413-48d6-ae5b-d60e58c264fd" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Deleting offline snapshot 995e0b82-f413-48d6-ae5b-d60e58c264fd of volume 6c449488-40f8-40fe-8f84-1b315eafb7ac {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] snapshot_file for this snap is: volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b55b960-5ecd-4d56-8a9e-185c5eff1ef7]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd" returned: 0 in 0.465s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c449488-40f8-40fe-8f84-1b315eafb7ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db31d174-ed01-4304-a680-2d7008ada6fe]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:46 devstack quobyte-client[83210]: System call of process 91258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:39:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac" returned: 0 in 0.889s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:47 devstack quobyte-client[83210]: System call of process 91261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:39:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd" returned: 0 in 0.410s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac.995e0b82-f413-48d6-ae5b-d60e58c264fd" returned: 0 in 0.268s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-995e0b82-f413-48d6-ae5b-d60e58c264fd" released by "_delete_snapshot" :: held 2.489s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-6c449488-40f8-40fe-8f84-1b315eafb7ac" released by "delete_snapshot" :: held 2.522s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:48 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=98,cinder:SELECT=101,cinder:INSERT=21,cinder:DELETE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:39:49 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=103,cinder:SELECT=99,cinder:INSERT=22,cinder:DELETE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:39:50 devstack cinder-volume[83184]: WARNING cinder.quota [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-841722984 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-841722984, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:39:50 devstack cinder-volume[83184]: WARNING cinder.quota [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-841722984 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-841722984, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:39:50 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['d24be94d-1c41-4e8c-b4a6-39f8fcd31509', '5e92c713-b52d-47df-9305-f5dcab4dc7ac', 'dc66034c-1381-48b2-91e2-0ff302299df4', '80a9b923-23c4-4814-b271-dc3bbe080f87'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:50 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f6079f57-11b1-4ebf-9c09-a575161eaf66 tempest-GroupSnapshotsTest-1438263681 None] group_snapshot 4f690c57-c4b2-4147-b029-6014956fbe7d: deleted successfully Sep 18 11:39:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:39:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "cinder-quobyte-6c449488-40f8-40fe-8f84-1b315eafb7ac" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:39:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-6c449488-40f8-40fe-8f84-1b315eafb7ac" acquired by "delete_volume" :: waited 0.048s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:39:52 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd664acf-bcc7-4ac0-8a84-9bd29e558b18]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:39:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac" returned: 0 in 0.836s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6c449488-40f8-40fe-8f84-1b315eafb7ac" returned: 0 in 0.310s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Lock "cinder-quobyte-6c449488-40f8-40fe-8f84-1b315eafb7ac" released by "delete_volume" :: held 1.597s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:39:54 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['8938a369-4822-45af-9d35-3f4b149926c9'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:54 devstack cinder-volume[83184]: WARNING cinder.quota [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-841722984 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-841722984, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:39:54 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Created reservations ['4b3eb9e8-e43f-4d9c-9426-2efde467f85c', '6064affa-5885-42d1-a545-086c4dce46f0', '47b01372-dbb3-4888-ada3-7fc93cc1ff98', 'dc9260c5-9dbd-4a77-b3c5-8046ef6b6982'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:39:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:39:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:39:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:39:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:39:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:39:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:39:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.131s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:39:55 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:39:55 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cac36cf4-ba45-48ef-8ddd-7dd479291cdc tempest-GroupSnapshotsTest-1438263681 None] Delete group completed successfully. Sep 18 11:40:04 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=22 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:40:05 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:40:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-329b9ba3-9718-422a-8588-6a9670b46dd4 tempest-GroupSnapshotsV319Test-903530128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-329b9ba3-9718-422a-8588-6a9670b46dd4 tempest-GroupSnapshotsV319Test-903530128 None] Group tempest-GroupSnapshotsV319Test-Group-340960944: creating Sep 18 11:40:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-329b9ba3-9718-422a-8588-6a9670b46dd4 tempest-GroupSnapshotsV319Test-903530128 None] Group tempest-GroupSnapshotsV319Test-Group-340960944: created successfully Sep 18 11:40:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-329b9ba3-9718-422a-8588-6a9670b46dd4 tempest-GroupSnapshotsV319Test-903530128 None] Create group completed successfully. Sep 18 11:40:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Flow 'volume_create_manager' (f7260224-b0e4-4c95-bc6a-a536f135e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2175e3c-a116-456e-80e0-74d73d510076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2175e3c-a116-456e-80e0-74d73d510076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037756023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97d66698-35fc-4ae4-86a7-7a90ebf16869,host='devstack@QuobyteHD#QuobyteHD',id=b28d1e20-15ab-4946-ab4e-8c6636afc3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ee3769fe1344d388f6062542fa8b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:07Z,use_quota=True,user_id='d0fbdac4c46645329cfdfb10bacb9e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8875dfc-15d1-4f6a-8693-f71f15d1cc7a),volume_type_id=c8875dfc-15d1-4f6a-8693-f71f15d1cc7a)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4584e350-a9ff-4305-be14-b733e7ed13b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4584e350-a9ff-4305-be14-b733e7ed13b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ead9158-6a55-4ad6-b750-f9be8547117c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ead9158-6a55-4ad6-b750-f9be8547117c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b28d1e20-15ab-4946-ab4e-8c6636afc3e7', 'volume_name': 'volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e767e02e-96df-4410-b909-9601dc5228a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e767e02e-96df-4410-b909-9601dc5228a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9c8148-de6a-45a5-9801-0c1d4ea04551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:07 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Volume b28d1e20-15ab-4946-ab4e-8c6636afc3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7', 'volume_size': 1} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97d66698-35fc-4ae4-86a7-7a90ebf16869,created_at=2025-09-18T09:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037756023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97d66698-35fc-4ae4-86a7-7a90ebf16869,host='devstack@QuobyteHD#QuobyteHD',id=b28d1e20-15ab-4946-ab4e-8c6636afc3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ee3769fe1344d388f6062542fa8b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:07Z,use_quota=True,user_id='d0fbdac4c46645329cfdfb10bacb9e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8875dfc-15d1-4f6a-8693-f71f15d1cc7a),volume_type_id=c8875dfc-15d1-4f6a-8693-f71f15d1cc7a)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Creating volume b28d1e20-15ab-4946-ab4e-8c6636afc3e7 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:40:07 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:07 devstack quobyte-client[83210]: System call of process 91329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:40:07 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=32, name=volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 1073741824" returned: 0 in 0.438s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" returned: 0 in 0.127s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] <== create_volume: return (665ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:40:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9c8148-de6a-45a5-9801-0c1d4ea04551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d820cc4e-9d75-4fda-95b9-6b8c06707b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:08 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Volume volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 (b28d1e20-15ab-4946-ab4e-8c6636afc3e7): created successfully Sep 18 11:40:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d820cc4e-9d75-4fda-95b9-6b8c06707b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Flow 'volume_create_manager' (f7260224-b0e4-4c95-bc6a-a536f135e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:08 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-be3d65a9-9a8d-4c72-ba5a-c5348dd36f91 tempest-GroupSnapshotsV319Test-903530128 None] Created volume successfully. Sep 18 11:40:09 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] GroupSnapshot 6f2f73b0-a5be-434f-8f3f-9cec5b16c7e0: creating. Sep 18 11:40:09 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Group snapshot 6f2f73b0-a5be-434f-8f3f-9cec5b16c7e0: creating. {{(pid=83184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 18 11:40:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Creating offline snapshot 836c7bc3-f130-4165-8ebd-93f8e4dd4a81 of volume b28d1e20-15ab-4946-ab4e-8c6636afc3e7 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:40:09 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f8cce8-3961-4c83-86d7-f3fa8155928a]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:40:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" returned: 0 in 0.572s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:10 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=33, name=volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:40:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 1G" returned: 0 in 0.309s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] CMD "qemu-img rebase -u -b volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81" returned: 0 in 0.196s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81" returned: 0 in 0.147s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81" returned: 0 in 0.131s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.info" returned: 0 in 0.111s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.info" returned: 0 in 0.152s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:12 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7310b6d1-2670-42e0-9eef-ea3116473b4a tempest-GroupSnapshotsV319Test-903530128 None] group_snapshot 6f2f73b0-a5be-434f-8f3f-9cec5b16c7e0: created successfully Sep 18 11:40:13 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] group_snapshot 6f2f73b0-a5be-434f-8f3f-9cec5b16c7e0: deleting Sep 18 11:40:13 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] group_snapshot 6f2f73b0-a5be-434f-8f3f-9cec5b16c7e0: deleting {{(pid=83184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Acquiring lock "cinder-quobyte-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Lock "cinder-quobyte-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" acquired by "delete_snapshot" :: waited 0.095s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Acquiring lock "cinder-quobyte-836c7bc3-f130-4165-8ebd-93f8e4dd4a81" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Lock "cinder-quobyte-836c7bc3-f130-4165-8ebd-93f8e4dd4a81" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Deleting offline snapshot 836c7bc3-f130-4165-8ebd-93f8e4dd4a81 of volume b28d1e20-15ab-4946-ab4e-8c6636afc3e7 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] snapshot_file for this snap is: volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e489d4-2832-4f94-ac28-d548dbca5879]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:40:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81" returned: 0 in 0.476s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:40:14 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cdf1f8-877c-4d6f-9d52-9383366da6d3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:40:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" returned: 0 in 0.557s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81" returned: 0 in 0.236s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7.836c7bc3-f130-4165-8ebd-93f8e4dd4a81" returned: 0 in 0.156s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Lock "cinder-quobyte-836c7bc3-f130-4165-8ebd-93f8e4dd4a81" released by "_delete_snapshot" :: held 1.830s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Lock "cinder-quobyte-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" released by "delete_snapshot" :: held 1.861s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:16 devstack cinder-volume[83184]: WARNING cinder.quota [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1779335831 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1779335831, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:40:16 devstack cinder-volume[83184]: WARNING cinder.quota [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1779335831 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1779335831, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:40:16 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] Created reservations ['52d30aa4-5b66-41a3-aaf7-59ed14d26e7f', 'a1307981-29c4-4c2a-83ad-970bbf775910', 'bb0f0863-fc37-42b8-baa4-a59127cf45d1', 'f2591e8f-7c86-4e15-8547-7a85f4b6eed9'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b2be11df-184a-4f40-bef6-ad9af265bd14 tempest-GroupSnapshotsV319Test-903530128 None] group_snapshot 6f2f73b0-a5be-434f-8f3f-9cec5b16c7e0: deleted successfully Sep 18 11:40:17 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Acquiring lock "cinder-quobyte-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Lock "cinder-quobyte-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:17 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8864b64-24b8-41ee-bed5-8d8aff632765]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:40:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" returned: 0 in 0.880s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" returned: 0 in 0.179s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Lock "cinder-quobyte-b28d1e20-15ab-4946-ab4e-8c6636afc3e7" released by "delete_volume" :: held 1.474s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:20 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Created reservations ['836ae124-4b9d-4ebc-8c9d-8f8973cb0dd4'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:20 devstack cinder-volume[83184]: WARNING cinder.quota [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1779335831 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1779335831, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:40:20 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Created reservations ['67b81d71-a09c-4090-8293-176c3ae24dc8', 'd2f846f0-8401-46a1-872b-80a3b07e4663', 'a336b6e1-a392-42e2-82a1-c5c8658a5b84', '4c154f73-985b-4533-9778-b07edf3acf42'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.223s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:21 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:40:21 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-379da8fd-9d8d-4a9e-b37b-5bd415bbe7d0 tempest-GroupSnapshotsV319Test-903530128 None] Delete group completed successfully. Sep 18 11:40:24 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Flow 'volume_create_manager' (5362e6e9-62a5-460b-b17d-ee8a28e513d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bd8601-62e9-4389-84e1-d06ded66c6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bd8601-62e9-4389-84e1-d06ded66c6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-887338270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244ad3bf-fa11-48f3-95f1-24d5b989f0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5595325589bd4f309839ef66d006b4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:24Z,use_quota=True,user_id='04d2814999ce440c8e4c75cf2e6bea50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6866c4cd-b890-4c94-8a03-45c2a05b1318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6866c4cd-b890-4c94-8a03-45c2a05b1318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f674c96-d435-428c-8ead-8004cbd88b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f674c96-d435-428c-8ead-8004cbd88b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244ad3bf-fa11-48f3-95f1-24d5b989f0f7', 'volume_name': 'volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e1fd69-c751-4a43-b2b8-2790d2e537b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e1fd69-c751-4a43-b2b8-2790d2e537b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfb9e13-85fb-4378-94ca-a9a68532e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:24 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Volume 244ad3bf-fa11-48f3-95f1-24d5b989f0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7', 'volume_size': 1} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-887338270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244ad3bf-fa11-48f3-95f1-24d5b989f0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5595325589bd4f309839ef66d006b4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:24Z,use_quota=True,user_id='04d2814999ce440c8e4c75cf2e6bea50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Creating volume 244ad3bf-fa11-48f3-95f1-24d5b989f0f7 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:40:24 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:40:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:24 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=35, name=volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7 1073741824" returned: 0 in 0.468s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7" returned: 0 in 0.123s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] <== create_volume: return (695ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfb9e13-85fb-4378-94ca-a9a68532e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b4fbca-bfc1-42d7-a653-8dc5552450ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:25 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Volume volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7 (244ad3bf-fa11-48f3-95f1-24d5b989f0f7): created successfully Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b4fbca-bfc1-42d7-a653-8dc5552450ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Flow 'volume_create_manager' (5362e6e9-62a5-460b-b17d-ee8a28e513d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:26 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5ff6b1ea-6624-4058-8922-382d18ca2655 tempest-VolumesMetadataTest-1017666349 None] Created volume successfully. Sep 18 11:40:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Acquiring lock "cinder-244ad3bf-fa11-48f3-95f1-24d5b989f0f7-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Lock "cinder-244ad3bf-fa11-48f3-95f1-24d5b989f0f7-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Acquiring lock "cinder-quobyte-244ad3bf-fa11-48f3-95f1-24d5b989f0f7" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Lock "cinder-quobyte-244ad3bf-fa11-48f3-95f1-24d5b989f0f7" acquired by "delete_volume" :: waited 0.017s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:28 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b5a932-9428-4209-9f99-4eae30cfd7d2]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:40:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7" returned: 0 in 0.773s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-244ad3bf-fa11-48f3-95f1-24d5b989f0f7" returned: 0 in 0.179s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Lock "cinder-quobyte-244ad3bf-fa11-48f3-95f1-24d5b989f0f7" released by "delete_volume" :: held 1.189s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Created reservations ['547e7ad1-2bd6-459f-b1d3-4525c5f71909', 'a47b5406-3e44-4742-8cdc-5162e29b7a9f', '76e33ce6-f2a1-448f-bc38-79bf7f9e33b8', 'fc3d3ca3-dc6a-4f70-b153-76eab9a4fc05'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.169s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:29 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:40:30 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Deleted volume successfully. Sep 18 11:40:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40112565-01d3-471d-b1d6-f8f79c135de3 tempest-VolumesMetadataTest-1017666349 None] Lock "cinder-244ad3bf-fa11-48f3-95f1-24d5b989f0f7-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:39 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=24,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=11 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=43,cinder:SELECT=35,cinder:INSERT=2,cinder:DELETE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:40:40 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Flow 'volume_create_manager' (ee7f18bd-bfaa-491e-a7fe-28fe230833eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e2d52b-a28f-4dad-a2c4-99b591a4cd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e2d52b-a28f-4dad-a2c4-99b591a4cd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1448545649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9970b3-aecc-423c-b3a0-898ea717d9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dd20c875dd4ebd80a1bf5582ce451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:40Z,use_quota=True,user_id='7c6cc09002e0441ea92dd7fa9c54a0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf941c56-c3ca-40c6-a3e6-3614a383de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf941c56-c3ca-40c6-a3e6-3614a383de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d991e6-7de0-4eba-a020-0d550a06812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d991e6-7de0-4eba-a020-0d550a06812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9970b3-aecc-423c-b3a0-898ea717d9a0', 'volume_name': 'volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758d95f9-e953-478c-81c1-2f0102896333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758d95f9-e953-478c-81c1-2f0102896333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7ec639-2c52-47e1-90a5-82dc16ac739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:40 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Volume 3e9970b3-aecc-423c-b3a0-898ea717d9a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0', 'volume_size': 1} Sep 18 11:40:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1448545649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9970b3-aecc-423c-b3a0-898ea717d9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dd20c875dd4ebd80a1bf5582ce451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:40Z,use_quota=True,user_id='7c6cc09002e0441ea92dd7fa9c54a0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Creating volume 3e9970b3-aecc-423c-b3a0-898ea717d9a0 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:40:41 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:41 devstack quobyte-client[83210]: System call of process 91503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:40:41 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=36, name=volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0 1073741824" returned: 0 in 0.690s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0" returned: 0 in 0.261s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] <== create_volume: return (1354ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:40:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7ec639-2c52-47e1-90a5-82dc16ac739a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb35dc3-6c11-4413-8a17-d0d13aa67d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f4c98940-9b37-475d-bc2c-7afda89d8018 tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f4c98940-9b37-475d-bc2c-7afda89d8018 tempest-GroupsTest-1672222938 None] Group tempest-Group1-1399878841: creating Sep 18 11:40:43 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Volume volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0 (3e9970b3-aecc-423c-b3a0-898ea717d9a0): created successfully Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb35dc3-6c11-4413-8a17-d0d13aa67d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Flow 'volume_create_manager' (ee7f18bd-bfaa-491e-a7fe-28fe230833eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5e2f4b9a-132f-4d3f-8e7d-3a1f373b8059 tempest-VolumesTransfersV357Test-1066806546 None] Created volume successfully. Sep 18 11:40:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f4c98940-9b37-475d-bc2c-7afda89d8018 tempest-GroupsTest-1672222938 None] Group tempest-Group1-1399878841: created successfully Sep 18 11:40:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f4c98940-9b37-475d-bc2c-7afda89d8018 tempest-GroupsTest-1672222938 None] Create group completed successfully. Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:44 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-cbbbceb9-4fbd-4676-b327-b9a4047923ae tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:44 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cbbbceb9-4fbd-4676-b327-b9a4047923ae tempest-GroupsTest-1672222938 None] Group tempest-Group2-892622028: creating Sep 18 11:40:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 1.066s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:40:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cbbbceb9-4fbd-4676-b327-b9a4047923ae tempest-GroupsTest-1672222938 None] Group tempest-Group2-892622028: created successfully Sep 18 11:40:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cbbbceb9-4fbd-4676-b327-b9a4047923ae tempest-GroupsTest-1672222938 None] Create group completed successfully. Sep 18 11:40:45 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-6fbfa1b3-231f-4f06-9456-bf61aed9a587 tempest-VolumesTransfersV357Test-527912124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6fbfa1b3-231f-4f06-9456-bf61aed9a587 tempest-VolumesTransfersV357Test-527912124 None] Transfer volume completed successfully. Sep 18 11:40:46 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Flow 'volume_create_manager' (1c484447-690b-4e08-a159-84a02673c992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae952e1-4975-482c-8736-eac031eeeeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae952e1-4975-482c-8736-eac031eeeeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132006950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e48a04f-6a7a-429e-a901-7ae6ed398372,host='devstack@QuobyteHD#QuobyteHD',id=20ffe74d-72ed-4953-b0b3-cbbf5ca31d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f793bfd4ab47efa61ab96ef15e698c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:46Z,use_quota=True,user_id='fa92de9df4ab491f957e6b99d856e14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76009b04-099f-4165-9e99-12ac3cd94e6f),volume_type_id=76009b04-099f-4165-9e99-12ac3cd94e6f)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146c8db2-2012-4833-96df-a2ec9082b0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146c8db2-2012-4833-96df-a2ec9082b0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee008dd-c5db-4f9f-853d-fb884bf527f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee008dd-c5db-4f9f-853d-fb884bf527f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ffe74d-72ed-4953-b0b3-cbbf5ca31d17', 'volume_name': 'volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15256d8-77f2-494f-8315-a0007c059847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15256d8-77f2-494f-8315-a0007c059847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a9695d-27f6-43c0-afb7-ee81bcf8156d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:46 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Volume 20ffe74d-72ed-4953-b0b3-cbbf5ca31d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17', 'volume_size': 1} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e48a04f-6a7a-429e-a901-7ae6ed398372,created_at=2025-09-18T09:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132006950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e48a04f-6a7a-429e-a901-7ae6ed398372,host='devstack@QuobyteHD#QuobyteHD',id=20ffe74d-72ed-4953-b0b3-cbbf5ca31d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f793bfd4ab47efa61ab96ef15e698c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:46Z,use_quota=True,user_id='fa92de9df4ab491f957e6b99d856e14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76009b04-099f-4165-9e99-12ac3cd94e6f),volume_type_id=76009b04-099f-4165-9e99-12ac3cd94e6f)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Creating volume 20ffe74d-72ed-4953-b0b3-cbbf5ca31d17 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:40:46 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:40:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:46 devstack quobyte-client[83210]: System call of process 91511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:40:46 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=37, name=volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Acquiring lock "cinder-3e9970b3-aecc-423c-b3a0-898ea717d9a0-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17 1073741824" returned: 0 in 0.780s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Lock "cinder-3e9970b3-aecc-423c-b3a0-898ea717d9a0-delete_volume" acquired by "delete_volume" :: waited 0.272s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17" returned: 0 in 0.312s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] <== create_volume: return (1121ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:47 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Acquiring lock "cinder-quobyte-3e9970b3-aecc-423c-b3a0-898ea717d9a0" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a9695d-27f6-43c0-afb7-ee81bcf8156d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d6b2ae-53cd-44c4-9296-76bb304a6393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Lock "cinder-quobyte-3e9970b3-aecc-423c-b3a0-898ea717d9a0" acquired by "delete_volume" :: waited 0.077s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:47 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Volume volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17 (20ffe74d-72ed-4953-b0b3-cbbf5ca31d17): created successfully Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d6b2ae-53cd-44c4-9296-76bb304a6393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Flow 'volume_create_manager' (1c484447-690b-4e08-a159-84a02673c992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[193320ca-9581-40af-ab2f-110774e8eed5]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:40:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:48 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9053251a-2f2d-477d-b0cc-662b13565da4 tempest-GroupsTest-1672222938 None] Created volume successfully. Sep 18 11:40:48 devstack quobyte-client[83210]: System call of process 91516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:40:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0" returned: 0 in 0.793s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-3e9970b3-aecc-423c-b3a0-898ea717d9a0" returned: 0 in 0.312s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Lock "cinder-quobyte-3e9970b3-aecc-423c-b3a0-898ea717d9a0" released by "delete_volume" :: held 1.389s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:49 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Created reservations ['b7c7891f-e309-41a6-8b2d-64ff7a465d26', '76b220c7-54e9-41ca-bb16-81fdf6144673', '3bab0838-b2f8-45fa-98e8-371b9474233d', '5c45d57f-775d-4226-8c2b-6f1bb6765572'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:50 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Acquiring lock "cinder-quobyte-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.387s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:40:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Lock "cinder-quobyte-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17" acquired by "delete_volume" :: waited 0.182s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:51 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd45a4e-1cf3-4b6e-b354-68c2b4baec1f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:40:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:51 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Deleted volume successfully. Sep 18 11:40:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e672a1c1-33f0-44fd-b8c4-c75d7a542d3a tempest-VolumesTransfersV357Test-2112927666 None] Lock "cinder-3e9970b3-aecc-423c-b3a0-898ea717d9a0-delete_volume" released by "delete_volume" :: held 4.258s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:52 devstack quobyte-client[83210]: System call of process 91527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:40:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17" returned: 0 in 1.504s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:52 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Flow 'volume_create_manager' (a0a98b9a-69e7-47dd-bd8c-ce898a0bcde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623d1a76-c7ef-4e71-9633-ce23d3688459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17" returned: 0 in 0.593s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623d1a76-c7ef-4e71-9633-ce23d3688459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-542873847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90c6c4f-ad5d-41bf-8ed0-9bc954c68008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dd20c875dd4ebd80a1bf5582ce451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:52Z,use_quota=True,user_id='7c6cc09002e0441ea92dd7fa9c54a0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915d7eb5-04ff-4f68-a3e2-d2ae9b032794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915d7eb5-04ff-4f68-a3e2-d2ae9b032794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc68ca4d-50aa-491c-8318-c3149485d2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc68ca4d-50aa-491c-8318-c3149485d2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e90c6c4f-ad5d-41bf-8ed0-9bc954c68008', 'volume_name': 'volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d0a000-54d2-485b-851f-b8bea55143d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d0a000-54d2-485b-851f-b8bea55143d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3baba21-dc96-4616-9b7e-b1be9a9e0d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:53 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Volume e90c6c4f-ad5d-41bf-8ed0-9bc954c68008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008', 'volume_size': 1} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-542873847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90c6c4f-ad5d-41bf-8ed0-9bc954c68008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4dd20c875dd4ebd80a1bf5582ce451a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:40:52Z,use_quota=True,user_id='7c6cc09002e0441ea92dd7fa9c54a0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Creating volume e90c6c4f-ad5d-41bf-8ed0-9bc954c68008 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:40:53 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Lock "cinder-quobyte-20ffe74d-72ed-4953-b0b3-cbbf5ca31d17" released by "delete_volume" :: held 2.533s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:53 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=38, name=volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008 1073741824" returned: 0 in 0.789s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Created reservations ['79090b7e-7d9f-4fbe-a3bb-891eba514a7e'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008" returned: 0 in 0.562s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:54 devstack cinder-volume[83184]: WARNING cinder.quota [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1000884143 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1000884143, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:40:54 devstack cinder-volume[83184]: WARNING cinder.quota [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1000884143 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1000884143, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] <== create_volume: return (1452ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Created reservations ['983d6dfd-7dc4-4270-880c-9794451d3656', '5b2cbc9f-2779-4831-934b-f1e0f1eb8fc4', '359aaafb-f8cf-4b4b-a5a6-ddf9a11604b2', '99d5bd8e-94c4-421c-8c60-f7ab46e91077'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3baba21-dc96-4616-9b7e-b1be9a9e0d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed5470b-a346-4294-8c1a-652140a53a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:40:54 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Volume volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008 (e90c6c4f-ad5d-41bf-8ed0-9bc954c68008): created successfully Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed5470b-a346-4294-8c1a-652140a53a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:40:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Flow 'volume_create_manager' (a0a98b9a-69e7-47dd-bd8c-ce898a0bcde9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:40:54 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-88fb9a55-165c-468b-bbfe-15c636b12f4d tempest-VolumesTransfersV357Test-1066806546 None] Created volume successfully. Sep 18 11:40:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.161s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:55 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:40:55 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-050c4513-9f7f-4386-9b4f-31aa2e4274fd tempest-GroupsTest-1672222938 None] Delete group completed successfully. Sep 18 11:40:55 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Created reservations ['0cab2a8c-ec66-40f4-99f4-b1f35ccc5b8b'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.156s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:40:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e35e6bd1-85a3-47d6-8904-2675982d7abf tempest-GroupsTest-1672222938 None] Delete group completed successfully. Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Acquiring lock "cinder-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Lock "cinder-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Acquiring lock "cinder-quobyte-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:40:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Lock "cinder-quobyte-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:40:57 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155567a-0269-456c-962c-53a8b4ea0289]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:40:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008" returned: 0 in 0.809s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008" returned: 0 in 0.376s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:58 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b62b5dd8-72c5-4e3d-bcad-dedec3a9eb37 tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:40:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b62b5dd8-72c5-4e3d-bcad-dedec3a9eb37 tempest-GroupsTest-1672222938 None] Group tempest-GroupsTest-Group-199187367: creating Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Lock "cinder-quobyte-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008" released by "delete_volume" :: held 1.406s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:40:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b62b5dd8-72c5-4e3d-bcad-dedec3a9eb37 tempest-GroupsTest-1672222938 None] Group tempest-GroupsTest-Group-199187367: created successfully Sep 18 11:40:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b62b5dd8-72c5-4e3d-bcad-dedec3a9eb37 tempest-GroupsTest-1672222938 None] Create group completed successfully. Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Created reservations ['485ee988-32ad-4efb-b1d1-eb879fb1c59f', '8d54abcf-a105-4872-aa31-d4c6bbb9e3da', 'b9251b30-1153-4c43-b43f-367f34d6a563', 'e0f2ec2e-3af4-4f0a-9115-7c5feea9340a'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:40:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:40:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.124s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:40:59 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:40:59 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Deleted volume successfully. Sep 18 11:40:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-94987742-3129-4f4e-802d-5542c6e6a60f tempest-VolumesTransfersV357Test-2112927666 None] Lock "cinder-e90c6c4f-ad5d-41bf-8ed0-9bc954c68008-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:00 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Flow 'volume_create_manager' (2dbf14c3-ff2d-4b3b-b748-501d1d3e6ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ce6a94-5e71-4f42-ac35-b42c7d38f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ce6a94-5e71-4f42-ac35-b42c7d38f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1271528777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e216655-6d7c-418e-bba7-3e20ca919792,host='devstack@QuobyteHD#QuobyteHD',id=efefb980-a1e8-4f64-877b-b8c19a22013e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f793bfd4ab47efa61ab96ef15e698c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:00Z,use_quota=True,user_id='fa92de9df4ab491f957e6b99d856e14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b8e39b-e77e-4344-b23b-795e14b827bd),volume_type_id=78b8e39b-e77e-4344-b23b-795e14b827bd)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21397f78-38f0-4b10-b5d2-9798a9faca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21397f78-38f0-4b10-b5d2-9798a9faca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f39c3d3-7252-44b6-9305-f450312f738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f39c3d3-7252-44b6-9305-f450312f738b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efefb980-a1e8-4f64-877b-b8c19a22013e', 'volume_name': 'volume-efefb980-a1e8-4f64-877b-b8c19a22013e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5eef09-ee50-4c37-ab94-80be7f0f3b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5eef09-ee50-4c37-ab94-80be7f0f3b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8fea3b-7737-425a-aa8f-4532ec2afe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:00 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Volume efefb980-a1e8-4f64-877b-b8c19a22013e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efefb980-a1e8-4f64-877b-b8c19a22013e', 'volume_size': 1} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e216655-6d7c-418e-bba7-3e20ca919792,created_at=2025-09-18T09:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1271528777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e216655-6d7c-418e-bba7-3e20ca919792,host='devstack@QuobyteHD#QuobyteHD',id=efefb980-a1e8-4f64-877b-b8c19a22013e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f793bfd4ab47efa61ab96ef15e698c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:00Z,use_quota=True,user_id='fa92de9df4ab491f957e6b99d856e14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b8e39b-e77e-4344-b23b-795e14b827bd),volume_type_id=78b8e39b-e77e-4344-b23b-795e14b827bd)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Creating volume efefb980-a1e8-4f64-877b-b8c19a22013e {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:41:00 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:41:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-efefb980-a1e8-4f64-877b-b8c19a22013e 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:00 devstack quobyte-client[83210]: System call of process 91552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:00 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=39, name=volume-efefb980-a1e8-4f64-877b-b8c19a22013e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:41:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-efefb980-a1e8-4f64-877b-b8c19a22013e 1073741824" returned: 0 in 0.587s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-efefb980-a1e8-4f64-877b-b8c19a22013e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-efefb980-a1e8-4f64-877b-b8c19a22013e" returned: 0 in 0.836s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] <== create_volume: return (1560ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:41:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8fea3b-7737-425a-aa8f-4532ec2afe08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efefb980-a1e8-4f64-877b-b8c19a22013e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346f3f11-8e78-4ce5-a38a-68ce34bbb1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Volume volume-efefb980-a1e8-4f64-877b-b8c19a22013e (efefb980-a1e8-4f64-877b-b8c19a22013e): created successfully Sep 18 11:41:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346f3f11-8e78-4ce5-a38a-68ce34bbb1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Flow 'volume_create_manager' (2dbf14c3-ff2d-4b3b-b748-501d1d3e6ed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:02 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f72cf6a9-fefc-407a-87d3-b552bffb5157 tempest-GroupsTest-1672222938 None] Created volume successfully. Sep 18 11:41:03 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Flow 'volume_create_manager' (735ad104-a693-4d3f-ba57-b20697dd83a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21819f82-de81-48ab-9a65-b5cfc21c42de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21819f82-de81-48ab-9a65-b5cfc21c42de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1337599434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e216655-6d7c-418e-bba7-3e20ca919792,host='devstack@QuobyteHD#QuobyteHD',id=885c7e6e-a3ed-4235-8272-8e7dd31c65d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f793bfd4ab47efa61ab96ef15e698c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:03Z,use_quota=True,user_id='fa92de9df4ab491f957e6b99d856e14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b8e39b-e77e-4344-b23b-795e14b827bd),volume_type_id=78b8e39b-e77e-4344-b23b-795e14b827bd)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e5af7a-6b99-469f-90bc-b2c955c7d637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e5af7a-6b99-469f-90bc-b2c955c7d637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844b2100-3cc6-40fe-9714-6f775d77a762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844b2100-3cc6-40fe-9714-6f775d77a762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '885c7e6e-a3ed-4235-8272-8e7dd31c65d1', 'volume_name': 'volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047e2c18-4f4a-4618-92c0-d85dbdd6fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047e2c18-4f4a-4618-92c0-d85dbdd6fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8099bd64-7cf3-431b-ac06-b6005161f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:03 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Volume 885c7e6e-a3ed-4235-8272-8e7dd31c65d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1', 'volume_size': 1} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e216655-6d7c-418e-bba7-3e20ca919792,created_at=2025-09-18T09:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1337599434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e216655-6d7c-418e-bba7-3e20ca919792,host='devstack@QuobyteHD#QuobyteHD',id=885c7e6e-a3ed-4235-8272-8e7dd31c65d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f793bfd4ab47efa61ab96ef15e698c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:03Z,use_quota=True,user_id='fa92de9df4ab491f957e6b99d856e14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b8e39b-e77e-4344-b23b-795e14b827bd),volume_type_id=78b8e39b-e77e-4344-b23b-795e14b827bd)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Creating volume 885c7e6e-a3ed-4235-8272-8e7dd31c65d1 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:41:03 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:41:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:03 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=40, name=volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1 1073741824" returned: 0 in 0.488s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1" returned: 0 in 0.112s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] <== create_volume: return (702ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8099bd64-7cf3-431b-ac06-b6005161f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8799a57-ca0b-45aa-bce5-c0cff4375b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:04 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Volume volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1 (885c7e6e-a3ed-4235-8272-8e7dd31c65d1): created successfully Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8799a57-ca0b-45aa-bce5-c0cff4375b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Flow 'volume_create_manager' (735ad104-a693-4d3f-ba57-b20697dd83a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-12a6aff3-f3bd-4729-a2ac-102c1f2ac07c tempest-GroupsTest-1672222938 None] Created volume successfully. Sep 18 11:41:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-97de231c-d4e3-448e-a1c1-c09f3aa439c7 tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:06 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-97de231c-d4e3-448e-a1c1-c09f3aa439c7 tempest-GroupsTest-1672222938 None] Update group completed successfully. Sep 18 11:41:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f8a6fbf5-22a9-4359-b19b-694eb5b8b3cd tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:07 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f8a6fbf5-22a9-4359-b19b-694eb5b8b3cd tempest-GroupsTest-1672222938 None] Update group completed successfully. Sep 18 11:41:09 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Acquiring lock "cinder-quobyte-885c7e6e-a3ed-4235-8272-8e7dd31c65d1" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:41:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Lock "cinder-quobyte-885c7e6e-a3ed-4235-8272-8e7dd31c65d1" acquired by "delete_volume" :: waited 0.033s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:41:09 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfc0cb1-f14a-4674-8a6d-d1f7a4ffb4f2]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1" returned: 0 in 0.800s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:10 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Flow 'volume_create_manager' (6fe90c43-3a9b-4b63-bc36-d693754f5a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336c4853-c027-4dfa-90fb-d3d390156d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-885c7e6e-a3ed-4235-8272-8e7dd31c65d1" returned: 0 in 0.408s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336c4853-c027-4dfa-90fb-d3d390156d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1712048366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f7917b-4890-47b3-b281-0a5c92536029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c6d74428bb427bb5b0b0bb4cfd8f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:10Z,use_quota=True,user_id='ec08ea87dbd04eee8f52eee681fee833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168cd3cd-5034-4274-a928-d38a77c997f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168cd3cd-5034-4274-a928-d38a77c997f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac06af76-3817-451c-889f-05f0fe9f4008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac06af76-3817-451c-889f-05f0fe9f4008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f7917b-4890-47b3-b281-0a5c92536029', 'volume_name': 'volume-22f7917b-4890-47b3-b281-0a5c92536029', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4750f157-b97f-4262-966a-adb08abd95a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4750f157-b97f-4262-966a-adb08abd95a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b6e344-1101-4bda-b463-e96a32f85350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:10 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Volume 22f7917b-4890-47b3-b281-0a5c92536029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f7917b-4890-47b3-b281-0a5c92536029', 'volume_size': 1} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1712048366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f7917b-4890-47b3-b281-0a5c92536029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c6d74428bb427bb5b0b0bb4cfd8f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:10Z,use_quota=True,user_id='ec08ea87dbd04eee8f52eee681fee833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Creating volume 22f7917b-4890-47b3-b281-0a5c92536029 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:41:10 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-22f7917b-4890-47b3-b281-0a5c92536029 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Lock "cinder-quobyte-885c7e6e-a3ed-4235-8272-8e7dd31c65d1" released by "delete_volume" :: held 1.596s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Acquiring lock "cinder-quobyte-efefb980-a1e8-4f64-877b-b8c19a22013e" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:41:11 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=41, name=volume-22f7917b-4890-47b3-b281-0a5c92536029, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Lock "cinder-quobyte-efefb980-a1e8-4f64-877b-b8c19a22013e" acquired by "delete_volume" :: waited 0.120s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb5c1d9-ca25-40d1-b2ab-ccb8838d6224]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-efefb980-a1e8-4f64-877b-b8c19a22013e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-22f7917b-4890-47b3-b281-0a5c92536029 1073741824" returned: 0 in 0.679s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-22f7917b-4890-47b3-b281-0a5c92536029 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-22f7917b-4890-47b3-b281-0a5c92536029" returned: 0 in 0.141s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] <== create_volume: return (954ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-efefb980-a1e8-4f64-877b-b8c19a22013e" returned: 0 in 0.716s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-efefb980-a1e8-4f64-877b-b8c19a22013e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b6e344-1101-4bda-b463-e96a32f85350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f7917b-4890-47b3-b281-0a5c92536029', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4566bf-a10d-4141-9afa-a9c4453864cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-efefb980-a1e8-4f64-877b-b8c19a22013e" returned: 0 in 0.394s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Lock "cinder-quobyte-efefb980-a1e8-4f64-877b-b8c19a22013e" released by "delete_volume" :: held 1.270s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:12 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Volume volume-22f7917b-4890-47b3-b281-0a5c92536029 (22f7917b-4890-47b3-b281-0a5c92536029): created successfully Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4566bf-a10d-4141-9afa-a9c4453864cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Flow 'volume_create_manager' (6fe90c43-3a9b-4b63-bc36-d693754f5a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:12 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d52ee3f0-0157-4bba-a174-a059dfb497b8 tempest-VolumesNegativeTest-1104639520 None] Created volume successfully. Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Created reservations ['10752ca8-af0b-4643-a944-71fce334481e'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:41:12 devstack cinder-volume[83184]: WARNING cinder.quota [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1398425120 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1398425120, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:41:12 devstack cinder-volume[83184]: WARNING cinder.quota [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1398425120 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1398425120, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Created reservations ['b7f46490-cb5c-423f-abf4-32f486f1c5d9', '0a18c7be-5c64-471c-900a-f141874d7a44', '5063b691-3163-4fc9-bab9-a3e9fea12dee', 'e44c708a-6ae0-48d8-8537-30ac4cc79f8d'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:41:12 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Created reservations ['d46db464-a738-4351-8526-52bc74e06b52', 'a1e7cd6f-a060-4b19-a8d9-bdd0938abfe7', '42b0df5b-b296-48c8-a1a6-04669f29e847', '0c21cc59-e838-495a-bfd8-85c2292a6dae'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:41:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:41:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:41:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.211s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:13 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:41:13 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7dc54063-618e-4890-aad5-14ca3eee1b72 tempest-GroupsTest-1672222938 None] Delete group completed successfully. Sep 18 11:41:22 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Flow 'volume_create_manager' (107a5d59-ab11-46ef-abae-55fd5f256249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423829c4-9d24-49c2-8356-87449dc200b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423829c4-9d24-49c2-8356-87449dc200b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-460700007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bbe959-1247-49c6-af8d-f92b0b8586bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2109b3fd778e44dcb5f93d0c3ba9fe17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:22Z,use_quota=True,user_id='69a89968872b4fc58300aa0465dc745a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ca682e-9a89-4b95-8182-efa2d5dc1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ca682e-9a89-4b95-8182-efa2d5dc1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1de592e-95c8-4bc5-b251-a2a1c8d75d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1de592e-95c8-4bc5-b251-a2a1c8d75d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bbe959-1247-49c6-af8d-f92b0b8586bb', 'volume_name': 'volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00b24af-a74d-43b8-a697-7265afdddb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00b24af-a74d-43b8-a697-7265afdddb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f423d8-db1e-48bf-8173-1a18cb9cb682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:22 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Volume e2bbe959-1247-49c6-af8d-f92b0b8586bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb', 'volume_size': 1} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-460700007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bbe959-1247-49c6-af8d-f92b0b8586bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2109b3fd778e44dcb5f93d0c3ba9fe17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:22Z,use_quota=True,user_id='69a89968872b4fc58300aa0465dc745a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Creating volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:41:22 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:22 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=42, name=volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb 1073741824" returned: 0 in 0.404s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb" returned: 0 in 0.169s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] <== create_volume: return (668ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:41:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f423d8-db1e-48bf-8173-1a18cb9cb682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4037e6-233f-4665-bb1a-c2eb5c2a39c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:23 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Volume volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb (e2bbe959-1247-49c6-af8d-f92b0b8586bb): created successfully Sep 18 11:41:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4037e6-233f-4665-bb1a-c2eb5c2a39c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Flow 'volume_create_manager' (107a5d59-ab11-46ef-abae-55fd5f256249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a443e8d5-dfe5-4a50-9770-d09b73cf5972 tempest-SnapshotsActionsTest-535823162 None] Created volume successfully. Sep 18 11:41:25 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Creating offline snapshot fcdefe00-132e-4c79-bed4-e8a929d12c8f of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:41:25 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4624056d-de77-470a-85fe-be39328c6c75]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:26 devstack quobyte-client[83210]: System call of process 91645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb" returned: 0 in 0.939s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:26 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=43, name=volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:41:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f 1G" returned: 0 in 0.585s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:27 devstack quobyte-client[83210]: System call of process 91655 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.275s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:41:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.229s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:41:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.279s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.info" returned: 0 in 0.276s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:41:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.info" returned: 0 in 0.348s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.921s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:29 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cf18fdfe-89ba-45e5-8a1f-1c96c9be5ca7 tempest-SnapshotsActionsTest-535823162 None] Create snapshot completed successfully Sep 18 11:41:31 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Creating offline snapshot ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:41:31 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8a68b1-7e38-4a52-918a-dba13279d8f9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:31 devstack quobyte-client[83210]: System call of process 91676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.695s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:41:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:32 devstack quobyte-client[83210]: System call of process 91684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:32 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=45, name=volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:41:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 1G" returned: 0 in 0.367s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:32 devstack quobyte-client[83210]: System call of process 91688 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" returned: 0 in 0.216s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:41:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" returned: 0 in 0.126s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:41:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" returned: 0 in 0.099s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:33 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9f440590-e704-4833-b56e-5d24ee997080 tempest-SnapshotsActionsTest-535823162 None] Create snapshot completed successfully Sep 18 11:41:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-ea05f0fc-d386-4b46-ac4a-bbfa7ccee202-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:41:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-ea05f0fc-d386-4b46-ac4a-bbfa7ccee202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.136s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:41:34 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:41:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:41:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-quobyte-ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:41:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:41:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Deleting offline snapshot ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:41:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] snapshot_file for this snap is: volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:41:35 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[502d6c93-0f3b-4671-b89e-dbf0686b7f50]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:35 devstack quobyte-client[83210]: System call of process 91708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:35 devstack quobyte-client[83210]: System call of process 91708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" returned: 0 in 0.912s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:41:36 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e288ee-6717-4021-ad30-e12b368c5f02]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:37 devstack quobyte-client[83210]: System call of process 91718 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 1.471s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:41:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:38 devstack quobyte-client[83210]: System call of process 91748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" returned: 0 in 1.263s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" returned: 0 in 0.345s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-ea05f0fc-d386-4b46-ac4a-bbfa7ccee202" released by "_delete_snapshot" :: held 5.166s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" released by "delete_snapshot" :: held 5.225s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:40 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=76,cinder:SELECT=62,cinder:DELETE=6,cinder:INSERT=13 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:41:40 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=56,cinder:UPDATE=61,cinder:DELETE=5,cinder:INSERT=10 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:41:40 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Created reservations ['825cc675-441c-4dbd-b326-d6967b4f67b3', 'f5f508d8-13cb-44ca-8279-80d561c9d1a3', '4b13b19b-38ed-4167-abf6-400cb86ab52f', 'd672442d-36bd-4f57-aae2-5622683543bd'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:41:40 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Delete snapshot completed successfully. Sep 18 11:41:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba93be51-6fb4-4aa1-8028-2f46b04199c7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-ea05f0fc-d386-4b46-ac4a-bbfa7ccee202-delete_snapshot" released by "delete_snapshot" :: held 6.042s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:42 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Creating offline snapshot 3b8c2943-e175-46b7-a865-4499fe544193 of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:41:43 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebcdb7a-8014-4c17-994b-08dcb13b71b0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:41:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:44 devstack quobyte-client[83210]: System call of process 91789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 1.291s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.430s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:41:45 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=46, name=volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:41:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 1G" returned: 0 in 1.116s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193" returned: 0 in 0.385s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:41:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193" returned: 0 in 0.200s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:41:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193" returned: 0 in 0.838s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.738s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:48 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-370cfe68-68a2-420d-a2d4-d532b00ac9d9 tempest-SnapshotsActionsTest-535823162 None] Create snapshot completed successfully Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-3b8c2943-e175-46b7-a865-4499fe544193-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-3b8c2943-e175-46b7-a865-4499fe544193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.225s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:41:49 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:41:49 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Flow 'volume_create_manager' (649ab4a9-be23-4fba-8698-b6e91a524319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38929c8b-31fd-4bcc-a1c9-e4d56bd52320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" acquired by "delete_snapshot" :: waited 0.209s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-quobyte-3b8c2943-e175-46b7-a865-4499fe544193" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38929c8b-31fd-4bcc-a1c9-e4d56bd52320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1106629257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d48039-d9f4-4394-a75c-7fd41b44bba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8194112b18924cc6b50ba8e2fa3d385e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:49Z,use_quota=True,user_id='36f27458c3a0417482b22ee7c5c6d9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b7ca1b-5403-487c-b76f-56f795f5ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b7ca1b-5403-487c-b76f-56f795f5ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8616f910-3a23-48a4-a0e8-5c675fd884fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8616f910-3a23-48a4-a0e8-5c675fd884fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d48039-d9f4-4394-a75c-7fd41b44bba5', 'volume_name': 'volume-87d48039-d9f4-4394-a75c-7fd41b44bba5', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18914aa3-49fc-4109-a744-7230aa58fbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18914aa3-49fc-4109-a744-7230aa58fbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e191e47-4e00-4a23-a820-9b9d1a07798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:49 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume 87d48039-d9f4-4394-a75c-7fd41b44bba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d48039-d9f4-4394-a75c-7fd41b44bba5', 'volume_size': 1} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1106629257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d48039-d9f4-4394-a75c-7fd41b44bba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8194112b18924cc6b50ba8e2fa3d385e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:41:49Z,use_quota=True,user_id='36f27458c3a0417482b22ee7c5c6d9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Creating volume 87d48039-d9f4-4394-a75c-7fd41b44bba5 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:41:49 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:41:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87d48039-d9f4-4394-a75c-7fd41b44bba5 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:50 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=47, name=volume-87d48039-d9f4-4394-a75c-7fd41b44bba5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:41:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-3b8c2943-e175-46b7-a865-4499fe544193" acquired by "_delete_snapshot" :: waited 0.846s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:41:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Deleting offline snapshot 3b8c2943-e175-46b7-a865-4499fe544193 of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:41:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] snapshot_file for this snap is: volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:41:50 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f1c034-5a53-470e-b894-0f3eeecf08a6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87d48039-d9f4-4394-a75c-7fd41b44bba5 1073741824" returned: 0 in 2.090s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87d48039-d9f4-4394-a75c-7fd41b44bba5 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87d48039-d9f4-4394-a75c-7fd41b44bba5" returned: 0 in 0.680s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] <== create_volume: return (3047ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:41:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.091s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:41:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193" returned: 0 in 2.314s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:41:53 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dec220d-1275-442d-aaf6-f8a32250771d]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e191e47-4e00-4a23-a820-9b9d1a07798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d48039-d9f4-4394-a75c-7fd41b44bba5', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4acdbed-4762-4364-97ad-942a95c65f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:41:55 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume volume-87d48039-d9f4-4394-a75c-7fd41b44bba5 (87d48039-d9f4-4394-a75c-7fd41b44bba5): created successfully Sep 18 11:41:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4acdbed-4762-4364-97ad-942a95c65f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:41:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Flow 'volume_create_manager' (649ab4a9-be23-4fba-8698-b6e91a524319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:41:55 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2cd00f81-b03d-483a-a247-aac5583b4fa3 tempest-AttachVolumeShelveTestJSON-442706181 None] Created volume successfully. Sep 18 11:41:56 devstack quobyte-client[83210]: System call of process 91836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:41:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 2.788s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:41:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193" returned: 0 in 0.376s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:41:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.3b8c2943-e175-46b7-a865-4499fe544193" returned: 0 in 0.222s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:41:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-3b8c2943-e175-46b7-a865-4499fe544193" released by "_delete_snapshot" :: held 6.692s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" released by "delete_snapshot" :: held 7.587s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:57 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Created reservations ['a59ffa95-7b53-4efe-9192-135abbd3ced8', 'b0613917-2b44-4a5c-8cc2-aef40124fb24', 'afda2866-f71b-4913-9571-0fc897fee29c', 'b1d7e3cb-504d-424f-9b7d-fa98476c1708'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:41:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Delete snapshot completed successfully. Sep 18 11:41:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa43a9be-9f28-4968-a08e-085b63fd4e20 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-3b8c2943-e175-46b7-a865-4499fe544193-delete_snapshot" released by "delete_snapshot" :: held 9.152s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:41:59 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:41:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:41:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:41:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Creating offline snapshot 06f405b6-19ce-4098-86a6-76001520204b of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:41:59 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6788f7a9-0abd-4af8-8d63-0b9ee2ccd79b]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:41:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.508s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:42:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:00 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=48, name=volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b 1G" returned: 0 in 0.330s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:01 devstack quobyte-client[83210]: System call of process 91909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b" returned: 0 in 0.185s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:42:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b" returned: 0 in 0.105s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:42:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b" returned: 0 in 0.094s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.533s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:02 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-020d778a-9d71-49ae-ac98-b5be1ac7003c tempest-SnapshotsActionsTest-535823162 None] Create snapshot completed successfully Sep 18 11:42:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-06f405b6-19ce-4098-86a6-76001520204b-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-06f405b6-19ce-4098-86a6-76001520204b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:04 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-quobyte-06f405b6-19ce-4098-86a6-76001520204b" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-06f405b6-19ce-4098-86a6-76001520204b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Deleting offline snapshot 06f405b6-19ce-4098-86a6-76001520204b of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] snapshot_file for this snap is: volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eb9686-ad21-44da-ada0-299c4d6cf07a]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b" returned: 0 in 0.551s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a09b48-38a9-4b0c-827d-ce09b4f604e4]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:05 devstack quobyte-client[83210]: System call of process 91955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.653s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:42:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:05 devstack quobyte-client[83210]: System call of process 91961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b" returned: 0 in 0.433s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.06f405b6-19ce-4098-86a6-76001520204b" returned: 0 in 0.124s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-06f405b6-19ce-4098-86a6-76001520204b" released by "_delete_snapshot" :: held 2.244s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" released by "delete_snapshot" :: held 2.318s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:06 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Created reservations ['32503290-97ed-43f7-9006-7876eff5a460', 'c8d91e00-a8e2-4c47-adc8-6be3154f3d5c', '2ccb51cd-352e-4bdf-b7d3-620be9b1c2ed', '7dddad18-9c12-437f-9b36-fd8f4dac76cc'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:06 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Delete snapshot completed successfully. Sep 18 11:42:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8e0fefa1-a8e3-448b-943d-3420c9218673 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-06f405b6-19ce-4098-86a6-76001520204b-delete_snapshot" released by "delete_snapshot" :: held 2.917s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Creating offline snapshot e98eb335-eae0-4ba2-829c-a195f8da6651 of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:42:07 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[129572c1-a179-44cc-ab69-b8da6d5bea5d]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:08 devstack quobyte-client[83210]: System call of process 91973 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.816s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:42:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:09 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=49, name=volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 1G" returned: 0 in 0.301s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img rebase -u -b volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651" returned: 0 in 0.217s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651" returned: 0 in 0.137s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651" returned: 0 in 0.127s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:10 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a03dd633-1bb3-472b-be5d-c09071bdc8e6 tempest-SnapshotsActionsTest-535823162 None] Create snapshot completed successfully Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-e98eb335-eae0-4ba2-829c-a195f8da6651-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-e98eb335-eae0-4ba2-829c-a195f8da6651-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:11 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Acquiring lock "cinder-quobyte-e98eb335-eae0-4ba2-829c-a195f8da6651" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e98eb335-eae0-4ba2-829c-a195f8da6651" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Deleting offline snapshot e98eb335-eae0-4ba2-829c-a195f8da6651 of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] snapshot_file for this snap is: volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b0527e-8755-4ddf-940d-d0cbdb2c78e4]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:12 devstack quobyte-client[83210]: System call of process 91985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651" returned: 0 in 0.795s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:42:12 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2309af-cf66-40a1-ba84-b7fa99598a32]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:13 devstack quobyte-client[83210]: System call of process 91988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.785s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:42:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:13 devstack quobyte-client[83210]: System call of process 91991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651" returned: 0 in 0.550s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Acquiring lock "cinder-22f7917b-4890-47b3-b281-0a5c92536029-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.e98eb335-eae0-4ba2-829c-a195f8da6651" returned: 0 in 0.355s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Lock "cinder-22f7917b-4890-47b3-b281-0a5c92536029-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e98eb335-eae0-4ba2-829c-a195f8da6651" released by "_delete_snapshot" :: held 3.012s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" released by "delete_snapshot" :: held 3.060s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:14 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Acquiring lock "cinder-quobyte-22f7917b-4890-47b3-b281-0a5c92536029" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Lock "cinder-quobyte-22f7917b-4890-47b3-b281-0a5c92536029" acquired by "delete_volume" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Created reservations ['b7006e35-c072-4df6-b881-731ffdbf1ffc', '691ebdcc-89fc-4640-9c87-cfa73ecd15e0', '0f88d8ab-a880-4075-8e6d-f397a944b7eb', '8830849c-3c01-43e7-9422-f80dc20b36c9'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc37234-bf38-4a68-9c03-7051ca599a60]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-22f7917b-4890-47b3-b281-0a5c92536029 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Delete snapshot completed successfully. Sep 18 11:42:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-22f7917b-4890-47b3-b281-0a5c92536029" returned: 0 in 0.646s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-22f7917b-4890-47b3-b281-0a5c92536029 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ec8bbd0f-00e8-4288-900e-51db837f40d7 tempest-SnapshotsActionsTest-1812221887 None] Lock "cinder-e98eb335-eae0-4ba2-829c-a195f8da6651-delete_snapshot" released by "delete_snapshot" :: held 4.145s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-22f7917b-4890-47b3-b281-0a5c92536029" returned: 0 in 0.273s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Lock "cinder-quobyte-22f7917b-4890-47b3-b281-0a5c92536029" released by "delete_volume" :: held 1.030s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Created reservations ['fe46bd52-f5c4-4ef3-999e-4efdfc6fadc6', '6ff01f5e-8960-4558-8531-dfcff52cdcf2', '74c935f5-8dc4-42e4-aa1f-84231d1ea225', 'cf94b70c-df33-48e4-b568-186c4ea36238'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.224s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:42:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "cinder-fcdefe00-132e-4c79-bed4-e8a929d12c8f-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:17 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Deleted volume successfully. Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-fcdefe00-132e-4c79-bed4-e8a929d12c8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.442s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:17 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14d1e762-1ea8-4ccd-a4ec-3bb9a3e22d65 tempest-VolumesNegativeTest-1104639520 None] Lock "cinder-22f7917b-4890-47b3-b281-0a5c92536029-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "cinder-quobyte-fcdefe00-132e-4c79-bed4-e8a929d12c8f" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-quobyte-fcdefe00-132e-4c79-bed4-e8a929d12c8f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Deleting offline snapshot fcdefe00-132e-4c79-bed4-e8a929d12c8f of volume e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] snapshot_file for this snap is: volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6bc3c3-36db-4a34-ac13-cbc733c92ba3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.489s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:42:18 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69fe453-7a34-4d01-9110-5bcaa7b3acf5]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb" returned: 0 in 0.573s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.277s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb.fcdefe00-132e-4c79-bed4-e8a929d12c8f" returned: 0 in 0.140s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-quobyte-fcdefe00-132e-4c79-bed4-e8a929d12c8f" released by "_delete_snapshot" :: held 1.865s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" released by "delete_snapshot" :: held 1.907s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:19 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Created reservations ['5d41ac2f-1e4a-4b12-9013-c72a0b5052b4', '1bd0de2f-3797-4d5b-ab6f-0af0e1cfab99', 'e551ac5d-0fc1-4da2-ae80-b3d2077d7d31', 'f7850784-e171-466a-b3fb-a87dccf74862'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Delete snapshot completed successfully. Sep 18 11:42:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-25259332-f402-46ae-903b-b6e18fe2d577 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-fcdefe00-132e-4c79-bed4-e8a929d12c8f-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "cinder-e2bbe959-1247-49c6-af8d-f92b0b8586bb-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:20 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-56694c97-6ca5-445e-8ca6-8889e1a7bed3 req-88637389-775c-4afe-97d3-67ce45fe586c tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-e2bbe959-1247-49c6-af8d-f92b0b8586bb-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:20 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-56694c97-6ca5-445e-8ca6-8889e1a7bed3 req-88637389-775c-4afe-97d3-67ce45fe586c tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-56694c97-6ca5-445e-8ca6-8889e1a7bed3 req-88637389-775c-4afe-97d3-67ce45fe586c tempest-AttachVolumeShelveTestJSON-442706181 None] No connector for attachment 2b54aa9b-9b8a-44e5-89b1-72f4aaa1aa1d; skipping storage backend terminate_connection call. {{(pid=83184) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 18 11:42:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-56694c97-6ca5-445e-8ca6-8889e1a7bed3 req-88637389-775c-4afe-97d3-67ce45fe586c tempest-AttachVolumeShelveTestJSON-442706181 None] Deleting attachment 2b54aa9b-9b8a-44e5-89b1-72f4aaa1aa1d. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:42:20 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:20 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38425039-2e0d-44c0-b797-4fae33fe748a]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb" returned: 0 in 0.796s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:21 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:21 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (e6b5ecd2-c24c-4dc3-a898-1ab94f3ccdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0879ce04-2111-407a-81cd-f0b62af59338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e2bbe959-1247-49c6-af8d-f92b0b8586bb" returned: 0 in 0.886s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0879ce04-2111-407a-81cd-f0b62af59338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-37408333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6053e9-914c-44f8-b21e-fadc35090edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:21Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cc0970-033e-4b69-a196-b9d9e6179d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cc0970-033e-4b69-a196-b9d9e6179d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4388957-fedf-4c80-b74c-6e543e69e950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4388957-fedf-4c80-b74c-6e543e69e950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6053e9-914c-44f8-b21e-fadc35090edf', 'volume_name': 'volume-8f6053e9-914c-44f8-b21e-fadc35090edf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7bb70b-1260-4949-bac8-acff64371215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7bb70b-1260-4949-bac8-acff64371215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f54c07-7590-45fd-ae48-30fe1100b4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:22 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Volume 8f6053e9-914c-44f8-b21e-fadc35090edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6053e9-914c-44f8-b21e-fadc35090edf', 'volume_size': 1} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-37408333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6053e9-914c-44f8-b21e-fadc35090edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:21Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Creating volume 8f6053e9-914c-44f8-b21e-fadc35090edf {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:22 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8f6053e9-914c-44f8-b21e-fadc35090edf 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:22 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=50, name=volume-8f6053e9-914c-44f8-b21e-fadc35090edf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-quobyte-e2bbe959-1247-49c6-af8d-f92b0b8586bb" released by "delete_volume" :: held 3.100s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:23 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (fb62311f-f8ad-4704-8bbc-5760c71886a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ff7c95-a9d2-4f1b-892b-a8a2160c61b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ff7c95-a9d2-4f1b-892b-a8a2160c61b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-824529852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961343f2-da78-4b34-af09-9a3b33136626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:22Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f223fa05-e744-4faf-8fd5-7c9f000ae274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f223fa05-e744-4faf-8fd5-7c9f000ae274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5c4eee-80d2-4c41-bdae-281c007d2b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5c4eee-80d2-4c41-bdae-281c007d2b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961343f2-da78-4b34-af09-9a3b33136626', 'volume_name': 'volume-961343f2-da78-4b34-af09-9a3b33136626', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ab11f0-cf03-4766-99e3-9aedf72d9bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ab11f0-cf03-4766-99e3-9aedf72d9bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda96873-f39a-4127-8afe-a7aa7454a539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:23 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Volume 961343f2-da78-4b34-af09-9a3b33136626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961343f2-da78-4b34-af09-9a3b33136626', 'volume_size': 1} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:23 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (15f6db42-781a-4909-a901-963d550d2d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94981fdd-3c35-4396-b505-8732041fa3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (8a6eb6c9-8dd1-4c7a-b4c2-b403a92496ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c00ef7-4265-4bc2-ae25-8165d9744dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94981fdd-3c35-4396-b505-8732041fa3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1396434993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6903b11-6c73-4af4-b324-c9012ef0f987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:24Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6aa9c8-11d7-492d-b596-9e8dbc265d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6aa9c8-11d7-492d-b596-9e8dbc265d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bab563-df25-432c-a1cc-88783d44776c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bab563-df25-432c-a1cc-88783d44776c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6903b11-6c73-4af4-b324-c9012ef0f987', 'volume_name': 'volume-e6903b11-6c73-4af4-b324-c9012ef0f987', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a870bc1c-dcf0-4d4e-9c59-0480ee33f5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a870bc1c-dcf0-4d4e-9c59-0480ee33f5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7a522d-8a99-44b7-8831-0de34ce58269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Volume e6903b11-6c73-4af4-b324-c9012ef0f987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6903b11-6c73-4af4-b324-c9012ef0f987', 'volume_size': 1} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c00ef7-4265-4bc2-ae25-8165d9744dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-765822784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0b0190-5edc-40ef-ba80-0fd2934a1789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:22Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429cf198-b4fb-481d-a060-a69d03d3b6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429cf198-b4fb-481d-a060-a69d03d3b6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe1e834-2c03-4efb-a994-fa06eaff042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe1e834-2c03-4efb-a994-fa06eaff042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0b0190-5edc-40ef-ba80-0fd2934a1789', 'volume_name': 'volume-df0b0190-5edc-40ef-ba80-0fd2934a1789', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd191ddb-9f23-4569-950b-e1976cbc1cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd191ddb-9f23-4569-950b-e1976cbc1cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf60fe1-52e7-4e09-8d38-c0b45493f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Volume df0b0190-5edc-40ef-ba80-0fd2934a1789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0b0190-5edc-40ef-ba80-0fd2934a1789', 'volume_size': 1} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8f6053e9-914c-44f8-b21e-fadc35090edf 1073741824" returned: 0 in 1.570s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8f6053e9-914c-44f8-b21e-fadc35090edf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:24 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (57d37bae-1e76-4b33-866f-df7fad719ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdba2305-b5d5-4244-9348-098454339474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8f6053e9-914c-44f8-b21e-fadc35090edf" returned: 0 in 0.556s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] <== create_volume: return (2177ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-824529852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961343f2-da78-4b34-af09-9a3b33136626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:22Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Creating volume 961343f2-da78-4b34-af09-9a3b33136626 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:24 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-961343f2-da78-4b34-af09-9a3b33136626 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:24 devstack quobyte-client[83210]: System call of process 92055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:24 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=51, name=volume-961343f2-da78-4b34-af09-9a3b33136626, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdba2305-b5d5-4244-9348-098454339474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1654646949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d653d6-1ead-4ac6-8941-9f4bac0bdb99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:24Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f222ed-f8b7-4b4e-b893-b9f2f18da8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f222ed-f8b7-4b4e-b893-b9f2f18da8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25ad9af-3672-4527-9a8b-f55e931638a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25ad9af-3672-4527-9a8b-f55e931638a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d653d6-1ead-4ac6-8941-9f4bac0bdb99', 'volume_name': 'volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecca1448-b60a-435d-bd3b-dbe454e13d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecca1448-b60a-435d-bd3b-dbe454e13d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcf3003-a699-4af6-b4b9-a33b0d5ad76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:25 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Volume 42d653d6-1ead-4ac6-8941-9f4bac0bdb99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99', 'volume_size': 1} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f54c07-7590-45fd-ae48-30fe1100b4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6053e9-914c-44f8-b21e-fadc35090edf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efde23ca-646e-40bb-8f85-7619e1773959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-961343f2-da78-4b34-af09-9a3b33136626 1073741824" returned: 0 in 0.545s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-961343f2-da78-4b34-af09-9a3b33136626 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:25 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Volume volume-8f6053e9-914c-44f8-b21e-fadc35090edf (8f6053e9-914c-44f8-b21e-fadc35090edf): created successfully Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efde23ca-646e-40bb-8f85-7619e1773959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (e6b5ecd2-c24c-4dc3-a898-1ab94f3ccdc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-961343f2-da78-4b34-af09-9a3b33136626" returned: 0 in 0.440s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] <== create_volume: return (1023ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Created reservations ['29a08221-ca2d-4f8e-87bc-c36f6adb436d', '7be5208f-e163-4d5a-838c-b3393231a269', '3173a9bf-9703-483a-9a3a-af602a8286ca', 'd0b254c0-3028-40b2-8869-09995c076b75'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.770s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1396434993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6903b11-6c73-4af4-b324-c9012ef0f987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:24Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Creating volume e6903b11-6c73-4af4-b324-c9012ef0f987 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:25 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e6903b11-6c73-4af4-b324-c9012ef0f987 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:26 devstack quobyte-client[83210]: System call of process 92059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:26 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=52, name=volume-e6903b11-6c73-4af4-b324-c9012ef0f987, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:26 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b2f95141-635d-44aa-b030-dbd61718f7e1 tempest-CreateVolumesFromImageTest-1496371745 None] Created volume successfully. Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda96873-f39a-4127-8afe-a7aa7454a539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961343f2-da78-4b34-af09-9a3b33136626', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4be39d-081e-435b-9da6-a098dc7b973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e6903b11-6c73-4af4-b324-c9012ef0f987 1073741824" returned: 0 in 0.596s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e6903b11-6c73-4af4-b324-c9012ef0f987 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:26 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Volume volume-961343f2-da78-4b34-af09-9a3b33136626 (961343f2-da78-4b34-af09-9a3b33136626): created successfully Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4be39d-081e-435b-9da6-a098dc7b973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (fb62311f-f8ad-4704-8bbc-5760c71886a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e6903b11-6c73-4af4-b324-c9012ef0f987" returned: 0 in 0.355s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] <== create_volume: return (980ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-765822784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0b0190-5edc-40ef-ba80-0fd2934a1789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:22Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Creating volume df0b0190-5edc-40ef-ba80-0fd2934a1789 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:26 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df0b0190-5edc-40ef-ba80-0fd2934a1789 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:27 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=53, name=volume-df0b0190-5edc-40ef-ba80-0fd2934a1789, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.052s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:27 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f80430db-3786-4193-82e9-a4425e238d1e tempest-CreateVolumesFromImageTest-1496371745 None] Created volume successfully. Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7a522d-8a99-44b7-8831-0de34ce58269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6903b11-6c73-4af4-b324-c9012ef0f987', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7f8bb4-f6cd-421e-b152-7ee8a0f8f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df0b0190-5edc-40ef-ba80-0fd2934a1789 1073741824" returned: 0 in 0.925s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df0b0190-5edc-40ef-ba80-0fd2934a1789 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:27 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Volume volume-e6903b11-6c73-4af4-b324-c9012ef0f987 (e6903b11-6c73-4af4-b324-c9012ef0f987): created successfully Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7f8bb4-f6cd-421e-b152-7ee8a0f8f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (15f6db42-781a-4909-a901-963d550d2d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.904s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:42:28 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Deleted volume successfully. Sep 18 11:42:28 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-95699f47-598b-4b46-a8bb-aadadf3add2e tempest-CreateVolumesFromImageTest-1496371745 None] Created volume successfully. Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df0b0190-5edc-40ef-ba80-0fd2934a1789" returned: 0 in 0.441s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] <== create_volume: return (1390ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.181s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1654646949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d653d6-1ead-4ac6-8941-9f4bac0bdb99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183d4aa024804ba9bc864e42d6b7b64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:24Z,use_quota=True,user_id='9b2a9165a66849b79dd8af18db85f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Creating volume 42d653d6-1ead-4ac6-8941-9f4bac0bdb99 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:28 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:28 devstack quobyte-client[83210]: System call of process 92069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:28 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=54, name=volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf60fe1-52e7-4e09-8d38-c0b45493f03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0b0190-5edc-40ef-ba80-0fd2934a1789', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fe0153-b332-4b21-b025-a4845bf75b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99 1073741824" returned: 0 in 0.586s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd8b0bcd-6517-4dd9-8850-b790647a2478 tempest-SnapshotsActionsTest-535823162 None] Lock "cinder-e2bbe959-1247-49c6-af8d-f92b0b8586bb-delete_volume" released by "delete_volume" :: held 8.666s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:29 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Volume volume-df0b0190-5edc-40ef-ba80-0fd2934a1789 (df0b0190-5edc-40ef-ba80-0fd2934a1789): created successfully Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fe0153-b332-4b21-b025-a4845bf75b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (8a6eb6c9-8dd1-4c7a-b4c2-b403a92496ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99" returned: 0 in 0.429s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] <== create_volume: return (1045ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:29 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d2617bd1-686c-4846-8455-338d4f5491b6 tempest-CreateVolumesFromImageTest-1496371745 None] Created volume successfully. Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcf3003-a699-4af6-b4b9-a33b0d5ad76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd9a762-f172-4b37-af94-251ff7639223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:29 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Volume volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99 (42d653d6-1ead-4ac6-8941-9f4bac0bdb99): created successfully Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd9a762-f172-4b37-af94-251ff7639223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Flow 'volume_create_manager' (57d37bae-1e76-4b33-866f-df7fad719ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:29 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cfdaa4e3-161f-451a-8853-0d09aa3c7f16 tempest-CreateVolumesFromImageTest-1496371745 None] Created volume successfully. Sep 18 11:42:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-42d653d6-1ead-4ac6-8941-9f4bac0bdb99-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-42d653d6-1ead-4ac6-8941-9f4bac0bdb99-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-quobyte-42d653d6-1ead-4ac6-8941-9f4bac0bdb99" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-42d653d6-1ead-4ac6-8941-9f4bac0bdb99" acquired by "delete_volume" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:30 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94382ce-8d4a-4460-be66-d5bccc0d45b9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99" returned: 0 in 0.651s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-42d653d6-1ead-4ac6-8941-9f4bac0bdb99" returned: 0 in 0.162s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:31 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-42d653d6-1ead-4ac6-8941-9f4bac0bdb99" released by "delete_volume" :: held 1.058s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Created reservations ['af091591-da36-4d77-8186-10551cb368d4', 'b5d18d63-8289-4b06-8eed-bd638298a94f', '8e051c30-d8a2-41a5-89be-63c4d6996e81', 'cf8d7350-2014-43e0-b449-a70ba23f92b0'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.141s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:42:32 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Deleted volume successfully. Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-e6903b11-6c73-4af4-b324-c9012ef0f987-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3644b266-1bda-4729-afc5-3513c4a425f5 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-42d653d6-1ead-4ac6-8941-9f4bac0bdb99-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-e6903b11-6c73-4af4-b324-c9012ef0f987-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:33 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-quobyte-e6903b11-6c73-4af4-b324-c9012ef0f987" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-e6903b11-6c73-4af4-b324-c9012ef0f987" acquired by "delete_volume" :: waited 0.028s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:33 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[965225a1-2bcd-485e-9bbc-cf1801119a35]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e6903b11-6c73-4af4-b324-c9012ef0f987 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e6903b11-6c73-4af4-b324-c9012ef0f987" returned: 0 in 0.676s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e6903b11-6c73-4af4-b324-c9012ef0f987 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e6903b11-6c73-4af4-b324-c9012ef0f987" returned: 0 in 0.127s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-e6903b11-6c73-4af4-b324-c9012ef0f987" released by "delete_volume" :: held 0.990s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Created reservations ['94f80994-70d0-4a94-9b16-f2ab91153e4a', '179e13d0-b970-4a11-b559-6623af77b4e7', '8e132a84-0c99-4e89-88e2-295df5379e47', '933b0623-934c-4d72-9cb8-6d218d6eb500'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.113s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:34 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:42:35 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Deleted volume successfully. Sep 18 11:42:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-df0b0190-5edc-40ef-ba80-0fd2934a1789-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-df0b0190-5edc-40ef-ba80-0fd2934a1789-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-33b07721-84e4-409f-bac1-312cd5d55c25 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-e6903b11-6c73-4af4-b324-c9012ef0f987-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:35 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-quobyte-df0b0190-5edc-40ef-ba80-0fd2934a1789" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-df0b0190-5edc-40ef-ba80-0fd2934a1789" acquired by "delete_volume" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:35 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf8868-cd6d-4ea3-a3d6-a66aa09072a6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df0b0190-5edc-40ef-ba80-0fd2934a1789 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df0b0190-5edc-40ef-ba80-0fd2934a1789" returned: 0 in 0.767s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df0b0190-5edc-40ef-ba80-0fd2934a1789 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df0b0190-5edc-40ef-ba80-0fd2934a1789" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-df0b0190-5edc-40ef-ba80-0fd2934a1789" released by "delete_volume" :: held 1.035s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Created reservations ['6f742082-7908-4c46-b3f8-31188532d01d', '13f0a5fa-cf5e-4d6f-a46f-cc0ae3ca5b48', '1ebebdf8-b5af-41c6-bb0c-6790348b7fd5', '7c8cbabb-c8a0-480e-bb6c-da697a3bfc17'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.208s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:37 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:42:37 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Deleted volume successfully. Sep 18 11:42:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-961343f2-da78-4b34-af09-9a3b33136626-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-961343f2-da78-4b34-af09-9a3b33136626-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b9e45dd0-a642-4876-8920-185c60189af0 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-df0b0190-5edc-40ef-ba80-0fd2934a1789-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:38 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-quobyte-961343f2-da78-4b34-af09-9a3b33136626" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-961343f2-da78-4b34-af09-9a3b33136626" acquired by "delete_volume" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:38 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[305a620d-eb61-4c47-9bcb-a0aa2901b06e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-961343f2-da78-4b34-af09-9a3b33136626 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-961343f2-da78-4b34-af09-9a3b33136626" returned: 0 in 0.889s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-961343f2-da78-4b34-af09-9a3b33136626 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-961343f2-da78-4b34-af09-9a3b33136626" returned: 0 in 0.145s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-961343f2-da78-4b34-af09-9a3b33136626" released by "delete_volume" :: held 1.271s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:40 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Created reservations ['6d9e8b11-4531-4fdf-997c-b79e90d37359', 'a103cc0c-2b52-48fb-a511-9464fba52bcb', 'd3babeae-68d9-49a1-87f3-22f12438da32', '085003b3-aac3-435c-b9ed-0bac48173fb6'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.163s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:41 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:42:41 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Deleted volume successfully. Sep 18 11:42:41 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=85,cinder:SELECT=54,cinder:DELETE=10,cinder:INSERT=22 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:42:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-afb7422e-f559-4fa8-8a80-e51bcf53d7bc tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-961343f2-da78-4b34-af09-9a3b33136626-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-8f6053e9-914c-44f8-b21e-fadc35090edf-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-8f6053e9-914c-44f8-b21e-fadc35090edf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:41 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=73,cinder:INSERT=22,cinder:UPDATE=97,cinder:DELETE=5 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:42:41 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "cinder-quobyte-8f6053e9-914c-44f8-b21e-fadc35090edf" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:42:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-8f6053e9-914c-44f8-b21e-fadc35090edf" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:42:42 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed5779e-6ca8-4f1d-9a95-d5ec3760df51]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:42:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8f6053e9-914c-44f8-b21e-fadc35090edf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8f6053e9-914c-44f8-b21e-fadc35090edf" returned: 0 in 0.620s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8f6053e9-914c-44f8-b21e-fadc35090edf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8f6053e9-914c-44f8-b21e-fadc35090edf" returned: 0 in 0.244s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-quobyte-8f6053e9-914c-44f8-b21e-fadc35090edf" released by "delete_volume" :: held 1.237s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Created reservations ['5df724c2-1b53-4a6f-bd9d-82eeab1abb4c', 'c0358501-c477-462c-adde-766437631f35', 'c1dc5718-0a17-426d-9852-d99982510bd8', 'a9795f98-7fdf-4a83-9530-4a7bedb3d8cf'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.530s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.564s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:42:44 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Deleted volume successfully. Sep 18 11:42:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9f20e4af-951c-44bb-8a3d-4d895b53abf4 tempest-CreateVolumesFromImageTest-1496371745 None] Lock "cinder-8f6053e9-914c-44f8-b21e-fadc35090edf-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:42:50 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (3065f2cb-4e6e-4d67-88a4-bba2be6c78e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d75b4e9-0271-4a0f-bde2-5840112408dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d75b4e9-0271-4a0f-bde2-5840112408dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22748605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37127f5f-5463-4589-9402-cba227a6d535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:50Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5cc63d-5c19-41ba-8258-4fddd5341765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5cc63d-5c19-41ba-8258-4fddd5341765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db69f613-bef3-45e8-a0f8-a4d661661b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db69f613-bef3-45e8-a0f8-a4d661661b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37127f5f-5463-4589-9402-cba227a6d535', 'volume_name': 'volume-37127f5f-5463-4589-9402-cba227a6d535', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61303bb7-8e16-4408-a8f7-8e93d927cd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61303bb7-8e16-4408-a8f7-8e93d927cd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394f59ff-3d0e-4185-a73b-484b26355cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:50 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume 37127f5f-5463-4589-9402-cba227a6d535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37127f5f-5463-4589-9402-cba227a6d535', 'volume_size': 1} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22748605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37127f5f-5463-4589-9402-cba227a6d535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:50Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Creating volume 37127f5f-5463-4589-9402-cba227a6d535 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:50 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-37127f5f-5463-4589-9402-cba227a6d535 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:50 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=55, name=volume-37127f5f-5463-4589-9402-cba227a6d535, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-37127f5f-5463-4589-9402-cba227a6d535 1073741824" returned: 0 in 0.536s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-37127f5f-5463-4589-9402-cba227a6d535 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-37127f5f-5463-4589-9402-cba227a6d535" returned: 0 in 0.163s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:51 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] <== create_volume: return (855ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:42:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394f59ff-3d0e-4185-a73b-484b26355cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37127f5f-5463-4589-9402-cba227a6d535', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11102265-65bb-4b89-a620-364afcdc69ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:52 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume volume-37127f5f-5463-4589-9402-cba227a6d535 (37127f5f-5463-4589-9402-cba227a6d535): created successfully Sep 18 11:42:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11102265-65bb-4b89-a620-364afcdc69ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (3065f2cb-4e6e-4d67-88a4-bba2be6c78e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2e095882-43ca-4088-9023-328e994a8d7a tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created volume successfully. Sep 18 11:42:53 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (21346ad1-8b81-4b09-bd6d-38a2f0c4203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a7f71d-3ac4-40fe-819d-088f2fad240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a7f71d-3ac4-40fe-819d-088f2fad240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048445610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11be0e09-1124-402d-8ea1-841f203566f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:53Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddabcd44-c241-4472-add4-5ac2dfd9ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddabcd44-c241-4472-add4-5ac2dfd9ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d5e1f2-77fb-4c9a-8dab-17c2319a3030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d5e1f2-77fb-4c9a-8dab-17c2319a3030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11be0e09-1124-402d-8ea1-841f203566f3', 'volume_name': 'volume-11be0e09-1124-402d-8ea1-841f203566f3', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecaa4663-92b3-43e7-a21a-af244e68db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecaa4663-92b3-43e7-a21a-af244e68db1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0697cd59-8583-4f33-b57f-bf2aaf8fbe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:53 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume 11be0e09-1124-402d-8ea1-841f203566f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11be0e09-1124-402d-8ea1-841f203566f3', 'volume_size': 1} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048445610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11be0e09-1124-402d-8ea1-841f203566f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:53Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Creating volume 11be0e09-1124-402d-8ea1-841f203566f3 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:53 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-11be0e09-1124-402d-8ea1-841f203566f3 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:54 devstack quobyte-client[83210]: System call of process 92142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:54 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=56, name=volume-11be0e09-1124-402d-8ea1-841f203566f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-11be0e09-1124-402d-8ea1-841f203566f3 1073741824" returned: 0 in 0.733s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-11be0e09-1124-402d-8ea1-841f203566f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:54 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:54 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (696eaf67-1dd5-4136-b59c-e6e3ed45eca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dead4647-dff2-4443-9494-7b353c934e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-11be0e09-1124-402d-8ea1-841f203566f3" returned: 0 in 0.700s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] <== create_volume: return (1495ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dead4647-dff2-4443-9494-7b353c934e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1623406752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7104e8a-2db2-4d57-b47e-2489cff6ed08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:54Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1e714e-0bae-44aa-b01a-f3157f429cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1e714e-0bae-44aa-b01a-f3157f429cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfe4b34-d173-4792-8e07-9efd310c27e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfe4b34-d173-4792-8e07-9efd310c27e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7104e8a-2db2-4d57-b47e-2489cff6ed08', 'volume_name': 'volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc97dfc-4727-4891-aa20-bc7f672d5687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc97dfc-4727-4891-aa20-bc7f672d5687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d398be75-426e-40e6-8982-1b716730caae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:55 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume a7104e8a-2db2-4d57-b47e-2489cff6ed08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08', 'volume_size': 1} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1623406752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7104e8a-2db2-4d57-b47e-2489cff6ed08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:54Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Creating volume a7104e8a-2db2-4d57-b47e-2489cff6ed08 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:55 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:55 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:55 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=57, name=volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (1714c171-2972-4b6f-aeeb-41637b396a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650b5abe-60a4-4953-b1c4-28070c88f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0697cd59-8583-4f33-b57f-bf2aaf8fbe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11be0e09-1124-402d-8ea1-841f203566f3', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2ee0aa-2327-435a-8426-02fbec36f2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650b5abe-60a4-4953-b1c4-28070c88f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-658256858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f17fd96-1172-4c5b-8cdc-22fc0438cc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:55Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cc253d-3701-48ad-a3e6-e585422f8e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cc253d-3701-48ad-a3e6-e585422f8e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef47b05d-b793-42c7-9b64-e2432415da76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef47b05d-b793-42c7-9b64-e2432415da76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f17fd96-1172-4c5b-8cdc-22fc0438cc82', 'volume_name': 'volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb828a5-dc45-4640-9b23-bc4db5c728e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb828a5-dc45-4640-9b23-bc4db5c728e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15eb4cb-b48f-48b2-8be5-e7f5d1725a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:56 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume 9f17fd96-1172-4c5b-8cdc-22fc0438cc82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82', 'volume_size': 1} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:56 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume volume-11be0e09-1124-402d-8ea1-841f203566f3 (11be0e09-1124-402d-8ea1-841f203566f3): created successfully Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2ee0aa-2327-435a-8426-02fbec36f2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (21346ad1-8b81-4b09-bd6d-38a2f0c4203d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08 1073741824" returned: 0 in 1.339s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3890e4e1-a6a3-40d5-8d57-75db8533405d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created volume successfully. Sep 18 11:42:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (03421cd3-84d9-42e3-a80b-10863f7be959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477c77ff-390f-4dcd-aa4f-145979847218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08" returned: 0 in 0.897s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477c77ff-390f-4dcd-aa4f-145979847218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052319228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4929ea01-fbba-4c0e-ba38-14e8f494ec12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:56Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93720828-9f1f-4be3-aefd-df23a933a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93720828-9f1f-4be3-aefd-df23a933a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d527fef-8067-4ac9-bb66-bc6a2dac2bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d527fef-8067-4ac9-bb66-bc6a2dac2bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4929ea01-fbba-4c0e-ba38-14e8f494ec12', 'volume_name': 'volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5114a02e-f066-4ef7-84f6-7f8d7f2b77c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5114a02e-f066-4ef7-84f6-7f8d7f2b77c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd57155c-a689-465d-be6e-deb81e8e6e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:57 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume 4929ea01-fbba-4c0e-ba38-14e8f494ec12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12', 'volume_size': 1} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (c52b86a5-57a8-41ac-b8af-a98c740d718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29fa6ba-6504-4b45-8b30-54deebf6432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] <== create_volume: return (2350ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.060s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-658256858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f17fd96-1172-4c5b-8cdc-22fc0438cc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:55Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Creating volume 9f17fd96-1172-4c5b-8cdc-22fc0438cc82 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:42:57 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:42:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:57 devstack quobyte-client[83210]: System call of process 92164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:42:57 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=58, name=volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d398be75-426e-40e6-8982-1b716730caae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf71061b-144b-444a-95c9-303065b69cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29fa6ba-6504-4b45-8b30-54deebf6432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1728168820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba093c69-8839-40ae-9aaa-10122ea36c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:57Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30bb006-2e4e-49b9-b829-d385c61322d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30bb006-2e4e-49b9-b829-d385c61322d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb98403-7c3c-412c-916d-9e1f6562ba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb98403-7c3c-412c-916d-9e1f6562ba6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba093c69-8839-40ae-9aaa-10122ea36c8e', 'volume_name': 'volume-ba093c69-8839-40ae-9aaa-10122ea36c8e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ab8971-7b2b-4204-9398-0fc2c8678204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ab8971-7b2b-4204-9398-0fc2c8678204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab844b9-fd82-4fb0-90bf-1aac556c2215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:42:58 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume ba093c69-8839-40ae-9aaa-10122ea36c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba093c69-8839-40ae-9aaa-10122ea36c8e', 'volume_size': 1} Sep 18 11:42:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:42:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82 1073741824" returned: 0 in 1.272s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:42:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:42:59 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08 (a7104e8a-2db2-4d57-b47e-2489cff6ed08): created successfully Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf71061b-144b-444a-95c9-303065b69cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (696eaf67-1dd5-4136-b59c-e6e3ed45eca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82" returned: 0 in 1.386s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] <== create_volume: return (2743ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.761s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.906s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052319228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4929ea01-fbba-4c0e-ba38-14e8f494ec12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:56Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Creating volume 4929ea01-fbba-4c0e-ba38-14e8f494ec12 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:43:00 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:43:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:01 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d4b553c7-d827-4b24-aaa7-9be3eeffac7f tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created volume successfully. Sep 18 11:43:01 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=59, name=volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15eb4cb-b48f-48b2-8be5-e7f5d1725a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357cf677-74c5-4807-a68b-e40d5599196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12 1073741824" returned: 0 in 1.488s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82 (9f17fd96-1172-4c5b-8cdc-22fc0438cc82): created successfully Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357cf677-74c5-4807-a68b-e40d5599196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (1714c171-2972-4b6f-aeeb-41637b396a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:02 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-88b5d468-a435-409a-b0c2-9cbec32d658d tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created volume successfully. Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12" returned: 0 in 0.568s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] <== create_volume: return (2079ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.978s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1728168820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba093c69-8839-40ae-9aaa-10122ea36c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636bc8cc0b404e6387808dba463bcc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:42:57Z,use_quota=True,user_id='edd63799b1cf48db94a22aab7567aea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Creating volume ba093c69-8839-40ae-9aaa-10122ea36c8e {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:43:02 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:43:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ba093c69-8839-40ae-9aaa-10122ea36c8e 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:03 devstack quobyte-client[83210]: System call of process 92234 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:43:03 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=60, name=volume-ba093c69-8839-40ae-9aaa-10122ea36c8e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:43:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd57155c-a689-465d-be6e-deb81e8e6e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d793d0d3-705b-4a37-81ea-1b5fc5f79188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ba093c69-8839-40ae-9aaa-10122ea36c8e 1073741824" returned: 0 in 0.950s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ba093c69-8839-40ae-9aaa-10122ea36c8e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:03 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12 (4929ea01-fbba-4c0e-ba38-14e8f494ec12): created successfully Sep 18 11:43:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d793d0d3-705b-4a37-81ea-1b5fc5f79188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (03421cd3-84d9-42e3-a80b-10863f7be959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ba093c69-8839-40ae-9aaa-10122ea36c8e" returned: 0 in 0.470s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] <== create_volume: return (1463ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:43:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ce2aff2c-43c4-4198-a393-260e5003cd60 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created volume successfully. Sep 18 11:43:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab844b9-fd82-4fb0-90bf-1aac556c2215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba093c69-8839-40ae-9aaa-10122ea36c8e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff02478-6698-4b36-8cf3-e0eaaf140fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:04 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume volume-ba093c69-8839-40ae-9aaa-10122ea36c8e (ba093c69-8839-40ae-9aaa-10122ea36c8e): created successfully Sep 18 11:43:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff02478-6698-4b36-8cf3-e0eaaf140fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Flow 'volume_create_manager' (c52b86a5-57a8-41ac-b8af-a98c740d718f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d535ff0f-cba3-40c5-b243-2c4f583f07cd tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created volume successfully. Sep 18 11:43:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Flow 'volume_create_manager' (162d0f35-ddf4-4297-91a4-ddaefddcd8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfe0ea1-fd32-4232-87fd-a70683f8bd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfe0ea1-fd32-4232-87fd-a70683f8bd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1595230467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c3279f030447b2a1bfd8d23ef0be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:05Z,use_quota=True,user_id='5eb5001d36f84c22af785081990c2787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014de955-93e8-4fef-8302-685e76e39719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014de955-93e8-4fef-8302-685e76e39719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9595c65e-bbeb-4204-80ab-ed60efea38e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9595c65e-bbeb-4204-80ab-ed60efea38e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2', 'volume_name': 'volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110881f5-b6ed-4f3c-bad0-39beecbdc3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110881f5-b6ed-4f3c-bad0-39beecbdc3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f784b3b7-336a-4b23-b4a2-c2de46bcfb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:05 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Volume 5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2', 'volume_size': 1} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1595230467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c3279f030447b2a1bfd8d23ef0be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:05Z,use_quota=True,user_id='5eb5001d36f84c22af785081990c2787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Creating volume 5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:43:05 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:43:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:05 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=61, name=volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:43:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-ba093c69-8839-40ae-9aaa-10122ea36c8e-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2 1073741824" returned: 0 in 0.806s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-ba093c69-8839-40ae-9aaa-10122ea36c8e-delete_volume" acquired by "delete_volume" :: waited 0.386s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2" returned: 0 in 0.485s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] <== create_volume: return (1336ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:43:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f784b3b7-336a-4b23-b4a2-c2de46bcfb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e65eec6-9329-4ae2-b641-781cdf26d11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-quobyte-ba093c69-8839-40ae-9aaa-10122ea36c8e" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-ba093c69-8839-40ae-9aaa-10122ea36c8e" acquired by "delete_volume" :: waited 0.030s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:07 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Volume volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2 (5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2): created successfully Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e65eec6-9329-4ae2-b641-781cdf26d11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Flow 'volume_create_manager' (162d0f35-ddf4-4297-91a4-ddaefddcd8b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1b5f96-53b9-4a60-a2c6-c6a1a1dc6fe8]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ba093c69-8839-40ae-9aaa-10122ea36c8e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:07 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9780707a-312c-4840-9f92-17a6e1b79234 tempest-VolumeQuotasNegativeTestJSON-607099670 None] Created volume successfully. Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ba093c69-8839-40ae-9aaa-10122ea36c8e" returned: 0 in 0.627s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ba093c69-8839-40ae-9aaa-10122ea36c8e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ba093c69-8839-40ae-9aaa-10122ea36c8e" returned: 0 in 0.185s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-ba093c69-8839-40ae-9aaa-10122ea36c8e" released by "delete_volume" :: held 1.226s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:08 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created reservations ['fd43de27-b8a5-48cd-b12b-1314e77a6287', '626417eb-0591-4755-8933-348465dd7229', '546430fa-21db-4ea9-809a-e87b4c3928ab', '5b0eb63a-169a-4a5e-ac74-35059d3ad340'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.141s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:09 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Deleted volume successfully. Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-bc34bf5e-96a6-408e-b701-d6b2d4350b89 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-ba093c69-8839-40ae-9aaa-10122ea36c8e-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-4929ea01-fbba-4c0e-ba38-14e8f494ec12-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-4929ea01-fbba-4c0e-ba38-14e8f494ec12-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:10 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-quobyte-4929ea01-fbba-4c0e-ba38-14e8f494ec12" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-4929ea01-fbba-4c0e-ba38-14e8f494ec12" acquired by "delete_volume" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86efbc8e-79ec-45c4-88e3-297feea31280]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Acquiring lock "cinder-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "cinder-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:10 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Acquiring lock "cinder-quobyte-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "cinder-quobyte-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ddde4-185c-4ddf-ba0e-bdd4c6849dda]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:10 devstack quobyte-client[83210]: System call of process 92262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:43:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12" returned: 0 in 0.878s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4929ea01-fbba-4c0e-ba38-14e8f494ec12" returned: 0 in 0.137s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-4929ea01-fbba-4c0e-ba38-14e8f494ec12" released by "delete_volume" :: held 1.221s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2" returned: 0 in 0.761s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2" returned: 0 in 0.206s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "cinder-quobyte-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2" released by "delete_volume" :: held 1.167s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created reservations ['06d6dcbe-1fe7-405b-b760-e036740c5b9a', '2b70d54f-5a26-41f2-9baf-afa9f3c7982a', 'a88a3a6d-3a6e-4926-8196-d5024beba650', '77022c8f-2655-4633-ada7-00ec54c44419'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Created reservations ['4c90d528-7aff-47c0-9699-e6a1e4594e8b', '5f4ef2b0-0c62-4e8a-95b5-4a0e9c6f98cd', 'fca807de-a9ca-471e-87a8-7eeb437bfdeb', '7da581f3-85f2-4b30-a7de-24bf2ec5fdbb'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.174s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:12 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Deleted volume successfully. Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ad961cd6-5c1b-4ec1-bf1b-3df8cf73cd7b tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-4929ea01-fbba-4c0e-ba38-14e8f494ec12-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.264s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:13 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Deleted volume successfully. Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-461ebf69-3c42-42ac-8a98-8957442ad60e tempest-VolumeQuotasNegativeTestJSON-607099670 None] Lock "cinder-5dc2f29d-8d95-481c-96e7-a0c54d0ce9e2-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-9f17fd96-1172-4c5b-8cdc-22fc0438cc82-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-9f17fd96-1172-4c5b-8cdc-22fc0438cc82-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:13 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-quobyte-9f17fd96-1172-4c5b-8cdc-22fc0438cc82" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-9f17fd96-1172-4c5b-8cdc-22fc0438cc82" acquired by "delete_volume" :: waited 0.022s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af20430-51ab-4e26-9831-cc2ff36cee68]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82" returned: 0 in 0.588s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9f17fd96-1172-4c5b-8cdc-22fc0438cc82" returned: 0 in 0.163s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-9f17fd96-1172-4c5b-8cdc-22fc0438cc82" released by "delete_volume" :: held 1.059s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created reservations ['393f9226-782f-46c1-9d59-de576d342ca0', '65d4e62c-4112-4332-8eec-85bccddec8c6', 'aa84dc98-ec46-4d6c-89af-81f5c00bd6bb', '80600999-777f-4e72-babf-561ec0b227f3'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.129s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Deleted volume successfully. Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b1170aca-fa5e-47ad-8dae-bb489e91e8f7 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-9f17fd96-1172-4c5b-8cdc-22fc0438cc82-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-a7104e8a-2db2-4d57-b47e-2489cff6ed08-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-a7104e8a-2db2-4d57-b47e-2489cff6ed08-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-quobyte-a7104e8a-2db2-4d57-b47e-2489cff6ed08" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-a7104e8a-2db2-4d57-b47e-2489cff6ed08" acquired by "delete_volume" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:16 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c24fb-1511-431e-a16a-abeccd36a653]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08" returned: 0 in 0.547s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a7104e8a-2db2-4d57-b47e-2489cff6ed08" returned: 0 in 0.129s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-a7104e8a-2db2-4d57-b47e-2489cff6ed08" released by "delete_volume" :: held 0.924s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created reservations ['ffaf17d8-1458-4c9e-9dd6-31b79cf8be63', '527c8f7b-cc0b-4e3c-b3ef-74a855765a15', 'f23e912a-2dd1-4565-b412-8f2677ac1adb', '6e188e08-7c5a-4d60-8fd3-a18538a2aece'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.117s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:17 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:17 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Deleted volume successfully. Sep 18 11:43:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6f8ef51c-4d43-4714-b020-c2bf33ae88c4 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-a7104e8a-2db2-4d57-b47e-2489cff6ed08-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-11be0e09-1124-402d-8ea1-841f203566f3-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-11be0e09-1124-402d-8ea1-841f203566f3-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:18 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-quobyte-11be0e09-1124-402d-8ea1-841f203566f3" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-11be0e09-1124-402d-8ea1-841f203566f3" acquired by "delete_volume" :: waited 0.010s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:18 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea20b9e-9001-4917-961e-23fce0df127c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-11be0e09-1124-402d-8ea1-841f203566f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-11be0e09-1124-402d-8ea1-841f203566f3" returned: 0 in 0.567s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-11be0e09-1124-402d-8ea1-841f203566f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-11be0e09-1124-402d-8ea1-841f203566f3" returned: 0 in 0.140s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-11be0e09-1124-402d-8ea1-841f203566f3" released by "delete_volume" :: held 1.023s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created reservations ['907296b2-9951-43a1-9e53-9f2f7d9ef586', '56bde309-daa2-46d2-8df2-4be3994887c1', '7fbd0056-3f76-4bbc-8c74-c6ebf2cd7698', '25b2a6fc-7a49-491b-aee5-31c3a08a438d'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.152s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:20 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Deleted volume successfully. Sep 18 11:43:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-514a3d60-f368-461c-9737-4ed005c2a5e9 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-11be0e09-1124-402d-8ea1-841f203566f3-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-37127f5f-5463-4589-9402-cba227a6d535-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-37127f5f-5463-4589-9402-cba227a6d535-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:21 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "cinder-quobyte-37127f5f-5463-4589-9402-cba227a6d535" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-37127f5f-5463-4589-9402-cba227a6d535" acquired by "delete_volume" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:21 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3758020-be36-467c-ba14-6036f154550d]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-37127f5f-5463-4589-9402-cba227a6d535 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-37127f5f-5463-4589-9402-cba227a6d535" returned: 0 in 0.684s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-37127f5f-5463-4589-9402-cba227a6d535 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-37127f5f-5463-4589-9402-cba227a6d535" returned: 0 in 0.184s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:22 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-quobyte-37127f5f-5463-4589-9402-cba227a6d535" released by "delete_volume" :: held 1.215s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:22 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Created reservations ['8cafde9b-7f25-4866-be27-50540dc6472a', '6cd58fb8-ee3c-45fc-bf83-83fdb4c9b7e4', '8deb9510-315d-4d82-95ce-e4a0e0dc4316', 'ff3edcee-b1dc-4db1-855b-01b0532539bc'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.128s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:23 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Deleted volume successfully. Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60d76989-5741-40d2-aaf4-236d5067f023 tempest-CreateVolumesFromSourceVolumeTest-416044749 None] Lock "cinder-37127f5f-5463-4589-9402-cba227a6d535-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:24 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Flow 'volume_create_manager' (45725114-e789-4e23-b49c-209cc071f1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1b25c8-8ae3-4163-a383-177ff7056fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1b25c8-8ae3-4163-a383-177ff7056fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1204179422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f046542-225a-47ac-8b76-aba1552d8a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec30db33101402dae3a903abf7178b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:24Z,use_quota=True,user_id='2d10ea5e24874ae193b2366d161877b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6fd222-83ce-46a2-a454-537d6399b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6fd222-83ce-46a2-a454-537d6399b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cf4030-6e4e-47f2-84fb-13670129319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cf4030-6e4e-47f2-84fb-13670129319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f046542-225a-47ac-8b76-aba1552d8a2e', 'volume_name': 'volume-6f046542-225a-47ac-8b76-aba1552d8a2e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa30c9c-54ca-4162-9cd6-d8b4c83b089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa30c9c-54ca-4162-9cd6-d8b4c83b089a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bef295-39e3-42ed-93f5-e1b0345ea792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:24 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Volume 6f046542-225a-47ac-8b76-aba1552d8a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f046542-225a-47ac-8b76-aba1552d8a2e', 'volume_size': 1} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1204179422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f046542-225a-47ac-8b76-aba1552d8a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec30db33101402dae3a903abf7178b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:24Z,use_quota=True,user_id='2d10ea5e24874ae193b2366d161877b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Creating volume 6f046542-225a-47ac-8b76-aba1552d8a2e {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:43:24 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:43:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6f046542-225a-47ac-8b76-aba1552d8a2e 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:25 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=62, name=volume-6f046542-225a-47ac-8b76-aba1552d8a2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:43:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6f046542-225a-47ac-8b76-aba1552d8a2e 1073741824" returned: 0 in 0.694s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6f046542-225a-47ac-8b76-aba1552d8a2e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6f046542-225a-47ac-8b76-aba1552d8a2e" returned: 0 in 0.278s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] <== create_volume: return (1059ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:43:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bef295-39e3-42ed-93f5-e1b0345ea792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f046542-225a-47ac-8b76-aba1552d8a2e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef343fcc-6936-4914-af6c-afe933243819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:26 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Volume volume-6f046542-225a-47ac-8b76-aba1552d8a2e (6f046542-225a-47ac-8b76-aba1552d8a2e): created successfully Sep 18 11:43:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef343fcc-6936-4914-af6c-afe933243819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Flow 'volume_create_manager' (45725114-e789-4e23-b49c-209cc071f1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:26 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-009f49f0-9a58-4541-af79-94b3b9736f83 tempest-VolumesServicesTestJSON-1645903164 None] Created volume successfully. Sep 18 11:43:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Acquiring lock "cinder-6f046542-225a-47ac-8b76-aba1552d8a2e-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Lock "cinder-6f046542-225a-47ac-8b76-aba1552d8a2e-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Acquiring lock "cinder-quobyte-6f046542-225a-47ac-8b76-aba1552d8a2e" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Lock "cinder-quobyte-6f046542-225a-47ac-8b76-aba1552d8a2e" acquired by "delete_volume" :: waited 0.038s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:27 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadb3f65-d45c-4b91-9eef-4734e7b91e1f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6f046542-225a-47ac-8b76-aba1552d8a2e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6f046542-225a-47ac-8b76-aba1552d8a2e" returned: 0 in 0.532s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6f046542-225a-47ac-8b76-aba1552d8a2e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6f046542-225a-47ac-8b76-aba1552d8a2e" returned: 0 in 0.151s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Lock "cinder-quobyte-6f046542-225a-47ac-8b76-aba1552d8a2e" released by "delete_volume" :: held 0.909s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Created reservations ['fe4dded4-3c46-46f7-abc0-875e94b73c0c', '1f95389f-92c9-474c-a558-739819438431', 'ce50be6d-3aeb-488c-b8f8-b4b33dd079e3', '2d8e9dae-1921-46bc-96d1-98b130e0342e'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.112s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:29 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Deleted volume successfully. Sep 18 11:43:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f603912-0e78-49ee-b4da-04ed4c59eb19 tempest-VolumesServicesTestJSON-1645903164 None] Lock "cinder-6f046542-225a-47ac-8b76-aba1552d8a2e-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Flow 'volume_create_manager' (0dd61c33-121a-49e7-a779-64492e66707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12106bc5-8abc-4bed-8997-da7e67bfefab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12106bc5-8abc-4bed-8997-da7e67bfefab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fa5b40337e4e77b6c765f7ec6df8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:30Z,use_quota=True,user_id='7cc95527f0a14be2851b1b1a9c3f109a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c35c1b-5cce-4fc8-8902-029436869ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c35c1b-5cce-4fc8-8902-029436869ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbd9fcb-2193-4772-9121-7042619016cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbd9fcb-2193-4772-9121-7042619016cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1', 'volume_name': 'volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5503a0d-5a7c-44a5-8c0f-f9ef214f7f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5503a0d-5a7c-44a5-8c0f-f9ef214f7f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4afed0-894c-4591-92f1-35b0da27ace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:30 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Volume e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1', 'volume_size': 1} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fa5b40337e4e77b6c765f7ec6df8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:30Z,use_quota=True,user_id='7cc95527f0a14be2851b1b1a9c3f109a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Creating volume e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:43:30 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:43:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:31 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=63, name=volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:43:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1 1073741824" returned: 0 in 0.697s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1" returned: 0 in 0.124s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] <== create_volume: return (924ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:43:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4afed0-894c-4591-92f1-35b0da27ace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194674cd-3fbe-4ceb-9c57-1ea8a9e74210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:32 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Volume volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1 (e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1): created successfully Sep 18 11:43:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194674cd-3fbe-4ceb-9c57-1ea8a9e74210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Flow 'volume_create_manager' (0dd61c33-121a-49e7-a779-64492e66707c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:32 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b9e05c9b-fed6-4567-af5b-8caa6e639b52 tempest-CinderUnicodeTest-93008478 None] Created volume successfully. Sep 18 11:43:33 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Flow 'volume_create_manager' (f7a4c9c5-00b0-4598-9f8a-d1e2632e41a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a28b48-1308-4752-bd0c-3eb85e4d7a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a28b48-1308-4752-bd0c-3eb85e4d7a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:43:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1276241701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ac67de-39f6-4ff7-aff5-d9764e33f415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fa5b40337e4e77b6c765f7ec6df8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:33Z,use_quota=True,user_id='7cc95527f0a14be2851b1b1a9c3f109a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516d5fdd-dd73-4df2-b226-0021ba3036a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516d5fdd-dd73-4df2-b226-0021ba3036a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761983c7-3d9b-4a4d-b9bd-a5d4b4c8337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761983c7-3d9b-4a4d-b9bd-a5d4b4c8337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ac67de-39f6-4ff7-aff5-d9764e33f415', 'volume_name': 'volume-30ac67de-39f6-4ff7-aff5-d9764e33f415', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79e39b5-86bd-4f5a-833a-5922a40cf3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79e39b5-86bd-4f5a-833a-5922a40cf3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13fc5c0-1353-479a-910c-db529c86f493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:33 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Volume 30ac67de-39f6-4ff7-aff5-d9764e33f415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ac67de-39f6-4ff7-aff5-d9764e33f415', 'volume_size': 1} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:43:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1276241701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ac67de-39f6-4ff7-aff5-d9764e33f415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fa5b40337e4e77b6c765f7ec6df8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:43:33Z,use_quota=True,user_id='7cc95527f0a14be2851b1b1a9c3f109a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Creating volume 30ac67de-39f6-4ff7-aff5-d9764e33f415 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:43:33 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:33 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=64, name=volume-30ac67de-39f6-4ff7-aff5-d9764e33f415, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 1073741824" returned: 0 in 0.436s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415" returned: 0 in 0.194s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] <== create_volume: return (707ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:43:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13fc5c0-1353-479a-910c-db529c86f493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ac67de-39f6-4ff7-aff5-d9764e33f415', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8504caad-9d9f-4d1d-a2b5-1d0c8b621d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:43:34 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Volume volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 (30ac67de-39f6-4ff7-aff5-d9764e33f415): created successfully Sep 18 11:43:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8504caad-9d9f-4d1d-a2b5-1d0c8b621d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:43:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Flow 'volume_create_manager' (f7a4c9c5-00b0-4598-9f8a-d1e2632e41a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:43:34 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-05183722-e196-4dd7-8428-49cbef7771e4 tempest-CinderUnicodeTest-93008478 None] Created volume successfully. Sep 18 11:43:36 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Creating offline snapshot 32312ef8-a3da-4b74-8030-7aa20ff3ab4f of volume 30ac67de-39f6-4ff7-aff5-d9764e33f415 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:43:36 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78384a74-698e-4fd0-96ad-a0e878620242]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415" returned: 0 in 0.592s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:37 devstack quobyte-client[83210]: System call of process 92350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:43:37 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=65, name=volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f 1G" returned: 0 in 0.346s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): qemu-img rebase -u -b volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:37 devstack quobyte-client[83210]: System call of process 92354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] CMD "qemu-img rebase -u -b volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f" returned: 0 in 0.259s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f" returned: 0 in 0.138s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f" returned: 0 in 0.139s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.info" returned: 0 in 0.153s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:43:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.info" returned: 0 in 0.150s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:38 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-41b397d4-960e-448e-be8e-d1807ef7f96d tempest-CinderUnicodeTest-93008478 None] Create snapshot completed successfully Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "cinder-32312ef8-a3da-4b74-8030-7aa20ff3ab4f-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-32312ef8-a3da-4b74-8030-7aa20ff3ab4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:39 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "cinder-quobyte-30ac67de-39f6-4ff7-aff5-d9764e33f415" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-quobyte-30ac67de-39f6-4ff7-aff5-d9764e33f415" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "cinder-quobyte-32312ef8-a3da-4b74-8030-7aa20ff3ab4f" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-quobyte-32312ef8-a3da-4b74-8030-7aa20ff3ab4f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Deleting offline snapshot 32312ef8-a3da-4b74-8030-7aa20ff3ab4f of volume 30ac67de-39f6-4ff7-aff5-d9764e33f415 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] snapshot_file for this snap is: volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284bc34-07ee-4fb1-82c2-b60a5dfe960d]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:40 devstack quobyte-client[83210]: System call of process 92362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:43:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f" returned: 0 in 0.568s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30ac67de-39f6-4ff7-aff5-d9764e33f415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:43:40 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9595e8-3c4a-4494-ba75-56b899b6230e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:40 devstack quobyte-client[83210]: System call of process 92365 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:43:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415" returned: 0 in 0.555s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:41 devstack quobyte-client[83210]: System call of process 92368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:43:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f" returned: 0 in 0.326s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415.32312ef8-a3da-4b74-8030-7aa20ff3ab4f" returned: 0 in 0.139s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-quobyte-32312ef8-a3da-4b74-8030-7aa20ff3ab4f" released by "_delete_snapshot" :: held 1.997s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-quobyte-30ac67de-39f6-4ff7-aff5-d9764e33f415" released by "delete_snapshot" :: held 2.026s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:41 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=63,cinder:UPDATE=92,cinder:DELETE=11,cinder:INSERT=18 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:43:42 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Created reservations ['551b812b-aae1-4aec-a9e0-ea337efc9fc6', 'ed86a6c3-72b9-49a0-ab75-6a20840e231b', '26761a90-4a67-4eda-bd48-33747b007ccd', 'bae9819a-c863-464d-93ea-b8637f113446'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:42 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Delete snapshot completed successfully. Sep 18 11:43:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d981682-df18-4905-9912-3267ffc04f12 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-32312ef8-a3da-4b74-8030-7aa20ff3ab4f-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "cinder-30ac67de-39f6-4ff7-aff5-d9764e33f415-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-30ac67de-39f6-4ff7-aff5-d9764e33f415-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:42 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=56,cinder:INSERT=21,cinder:UPDATE=102,cinder:DELETE=9 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:43:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "cinder-quobyte-30ac67de-39f6-4ff7-aff5-d9764e33f415" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-quobyte-30ac67de-39f6-4ff7-aff5-d9764e33f415" acquired by "delete_volume" :: waited 0.022s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:43 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd81890b-aff6-41d1-a919-9d53935c61af]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415" returned: 0 in 0.629s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:43 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-30ac67de-39f6-4ff7-aff5-d9764e33f415" returned: 0 in 0.495s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-quobyte-30ac67de-39f6-4ff7-aff5-d9764e33f415" released by "delete_volume" :: held 1.364s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.545s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:44 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Created reservations ['fadd31a6-d45e-46db-8528-8463dfca7a2e', '67e883b7-33e1-4677-a38a-0e7fc64a4742', '50e4e06f-7f5f-4020-8dc1-71748a011b52', '69ff6d5c-4aa4-4348-88e2-0d308ba3eb81'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.230s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Deleted volume successfully. Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "cinder-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7e5234b8-687b-4cac-bbdd-797b274f31a4 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-30ac67de-39f6-4ff7-aff5-d9764e33f415-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:46 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:43:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "cinder-quobyte-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:43:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-quobyte-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1" acquired by "delete_volume" :: waited 0.090s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:43:46 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d1e9c8-df77-4ace-b4a4-16ce3554856c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:43:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:47 devstack quobyte-client[83210]: System call of process 92378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:43:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1" returned: 0 in 1.141s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1" returned: 0 in 0.173s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-quobyte-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1" released by "delete_volume" :: held 1.572s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Created reservations ['4dc20fe7-5d0e-40e8-8245-e3add9d58d47', '56d79685-5121-4ad9-8d46-0d8836b8be63', '3af5573b-20c2-4592-b63f-4a08e14e1e8e', 'bafed4be-27a5-4d55-9b1a-08e7e6ead312'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.116s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:43:48 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Deleted volume successfully. Sep 18 11:43:48 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f56c2f75-6f8e-412d-b385-091877ee8e42 tempest-CinderUnicodeTest-93008478 None] Lock "cinder-e11c8c08-95ca-457d-bdaa-cbfc6e19f4c1-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:43:58 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:INSERT=4,cinder:UPDATE=25,cinder:SELECT=14 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:43:58 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:44:01 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:01 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Flow 'volume_create_manager' (2d6c66c1-e2e0-4640-b1ad-3fd691d45d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fa8e2c-5a84-46b4-a0f9-ba04868ad31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fa8e2c-5a84-46b4-a0f9-ba04868ad31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1725056586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ecde14c-a02f-4637-a8bb-f0a6a69e3432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21a9e2bf8d246cfa2000da09bd07544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:02Z,use_quota=True,user_id='cbec01a09ac44c868fb8620e783b10fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b322b47d-5926-41e4-b8ba-4becc26e7c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b322b47d-5926-41e4-b8ba-4becc26e7c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9bb318-44cc-4b7d-9839-b710884dbc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9bb318-44cc-4b7d-9839-b710884dbc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ecde14c-a02f-4637-a8bb-f0a6a69e3432', 'volume_name': 'volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ccb2f1-e2b0-4d0d-ab54-da619f6a992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ccb2f1-e2b0-4d0d-ab54-da619f6a992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0495daf-a8c9-496c-8d02-5c42c28aaead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Volume 4ecde14c-a02f-4637-a8bb-f0a6a69e3432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432', 'volume_size': 1} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1725056586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ecde14c-a02f-4637-a8bb-f0a6a69e3432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21a9e2bf8d246cfa2000da09bd07544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:02Z,use_quota=True,user_id='cbec01a09ac44c868fb8620e783b10fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Creating volume 4ecde14c-a02f-4637-a8bb-f0a6a69e3432 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:44:02 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:02 devstack quobyte-client[83210]: System call of process 92418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:44:02 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=67, name=volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 1073741824" returned: 0 in 0.509s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" returned: 0 in 0.155s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] <== create_volume: return (802ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:44:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0495daf-a8c9-496c-8d02-5c42c28aaead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf5dd6d-ae66-49c9-8870-6cba79db785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:03 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Volume volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 (4ecde14c-a02f-4637-a8bb-f0a6a69e3432): created successfully Sep 18 11:44:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf5dd6d-ae66-49c9-8870-6cba79db785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Flow 'volume_create_manager' (2d6c66c1-e2e0-4640-b1ad-3fd691d45d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:03 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cc82a46f-d549-4fd9-82e6-481fedf4fb05 tempest-SnapshotMetadataTestJSON-1132496985 None] Created volume successfully. Sep 18 11:44:04 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Creating offline snapshot e474ee3c-2f47-4470-aadd-0ec58f6f58fa of volume 4ecde14c-a02f-4637-a8bb-f0a6a69e3432 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:44:05 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd172722-6dec-4d8c-bdd9-e3e7ac37f7cd]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" returned: 0 in 0.946s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:06 devstack quobyte-client[83210]: System call of process 92425 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:44:06 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=68, name=volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:44:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa 1G" returned: 0 in 0.667s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "qemu-img rebase -u -b volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa" returned: 0 in 0.370s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:44:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa" returned: 0 in 0.303s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:44:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa" returned: 0 in 0.130s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.info" returned: 0 in 0.143s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:44:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.info" returned: 0 in 0.156s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:08 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2b604b0c-0349-4659-b714-e515a7a7b5ea tempest-SnapshotMetadataTestJSON-1132496985 None] Create snapshot completed successfully Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "cinder-e474ee3c-2f47-4470-aadd-0ec58f6f58fa-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-e474ee3c-2f47-4470-aadd-0ec58f6f58fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:11 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "cinder-quobyte-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-quobyte-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" acquired by "delete_snapshot" :: waited 0.046s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "cinder-quobyte-e474ee3c-2f47-4470-aadd-0ec58f6f58fa" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-quobyte-e474ee3c-2f47-4470-aadd-0ec58f6f58fa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Deleting offline snapshot e474ee3c-2f47-4470-aadd-0ec58f6f58fa of volume 4ecde14c-a02f-4637-a8bb-f0a6a69e3432 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] snapshot_file for this snap is: volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b198b-92c9-4186-bd5e-53f3bebc9371]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa" returned: 0 in 0.507s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:44:12 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cedb22-077c-4064-bcb9-73e73bf78141]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" returned: 0 in 0.576s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa" returned: 0 in 0.353s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432.e474ee3c-2f47-4470-aadd-0ec58f6f58fa" returned: 0 in 0.110s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-quobyte-e474ee3c-2f47-4470-aadd-0ec58f6f58fa" released by "_delete_snapshot" :: held 1.990s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-quobyte-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" released by "delete_snapshot" :: held 2.031s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:15 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Created reservations ['a56c1d2c-7cb6-4a84-b7b7-b99ccdf9b659', 'c892c67d-0e35-4960-875b-ade196348bdc', '4e04b99c-9a9d-4776-89a7-03da60834498', '72359a33-785f-4281-8c94-795bd39b3074'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:44:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Delete snapshot completed successfully. Sep 18 11:44:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-66e1905f-792d-46cb-b5c5-75deac368346 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-e474ee3c-2f47-4470-aadd-0ec58f6f58fa-delete_snapshot" released by "delete_snapshot" :: held 3.811s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "cinder-4ecde14c-a02f-4637-a8bb-f0a6a69e3432-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-4ecde14c-a02f-4637-a8bb-f0a6a69e3432-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "cinder-quobyte-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-quobyte-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" acquired by "delete_volume" :: waited 0.017s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:16 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d7db1d-dd0e-4785-bd72-534e17c2ad45]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" returned: 0 in 0.467s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" returned: 0 in 0.120s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-quobyte-4ecde14c-a02f-4637-a8bb-f0a6a69e3432" released by "delete_volume" :: held 0.802s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:17 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Created reservations ['a3dc8758-1270-488d-9b34-6e3211eeddee', 'd344e51e-0156-4f0a-9a74-02a8edd203c1', '2b5e136c-7ca1-436a-8cbb-52d962564e92', 'be0539da-c751-4086-899d-ed9ca66b3629'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.248s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:44:18 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Deleted volume successfully. Sep 18 11:44:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-01068870-14f1-41e9-9cd5-aeaf2e6b2f69 tempest-SnapshotMetadataTestJSON-1132496985 None] Lock "cinder-4ecde14c-a02f-4637-a8bb-f0a6a69e3432-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:25 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "cinder-87d48039-d9f4-4394-a75c-7fd41b44bba5-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:25 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "cinder-87d48039-d9f4-4394-a75c-7fd41b44bba5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:26 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:26 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "cinder-quobyte-87d48039-d9f4-4394-a75c-7fd41b44bba5" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:26 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "cinder-quobyte-87d48039-d9f4-4394-a75c-7fd41b44bba5" acquired by "delete_volume" :: waited 0.079s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:26 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:26 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:44:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Flow 'volume_create_manager' (88009a06-1e6b-4700-ab21-d581c635c8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97327d42-78f6-49e7-b72f-93da3dd88df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:26 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f17af5-d578-4a8d-841a-4e5b83ad557c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87d48039-d9f4-4394-a75c-7fd41b44bba5 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97327d42-78f6-49e7-b72f-93da3dd88df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-492606702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbfc4b9-584b-4b5e-9e52-d552d7318212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f198dca60e64a13bdf8d5bf9d99d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:26Z,use_quota=True,user_id='8b0e2559293b4d97b95bb9ac3037c474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0332eb-b760-472c-b1ae-3baf206f2c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0332eb-b760-472c-b1ae-3baf206f2c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65df1ce-d291-4cab-a5c3-17eaee6e2dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65df1ce-d291-4cab-a5c3-17eaee6e2dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbfc4b9-584b-4b5e-9e52-d552d7318212', 'volume_name': 'volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd721be-6f58-4069-a71f-3452c7cb4a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd721be-6f58-4069-a71f-3452c7cb4a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371c327e-a2b1-4757-8a31-47559669c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:27 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Volume 5fbfc4b9-584b-4b5e-9e52-d552d7318212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212', 'volume_size': 1} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-492606702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbfc4b9-584b-4b5e-9e52-d552d7318212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f198dca60e64a13bdf8d5bf9d99d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:26Z,use_quota=True,user_id='8b0e2559293b4d97b95bb9ac3037c474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Creating volume 5fbfc4b9-584b-4b5e-9e52-d552d7318212 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:44:27 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:27 devstack quobyte-client[83210]: System call of process 92531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:44:27 devstack quobyte-client[83210]: System call of process 92534 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:44:27 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=70, name=volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87d48039-d9f4-4394-a75c-7fd41b44bba5" returned: 0 in 1.361s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87d48039-d9f4-4394-a75c-7fd41b44bba5 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212 1073741824" returned: 0 in 0.654s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-87d48039-d9f4-4394-a75c-7fd41b44bba5" returned: 0 in 0.462s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212" returned: 0 in 0.302s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] <== create_volume: return (1047ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "cinder-quobyte-87d48039-d9f4-4394-a75c-7fd41b44bba5" released by "delete_volume" :: held 2.589s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371c327e-a2b1-4757-8a31-47559669c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b54c08-41fd-4221-89ab-76d7f917c92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:28 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Volume volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212 (5fbfc4b9-584b-4b5e-9e52-d552d7318212): created successfully Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b54c08-41fd-4221-89ab-76d7f917c92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Flow 'volume_create_manager' (88009a06-1e6b-4700-ab21-d581c635c8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:28 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-90ba0ee1-48f1-4832-9bb7-0dc567fff41a tempest-VolumesTransfersTest-88919376 None] Created volume successfully. Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Created reservations ['3b703e48-2574-4410-ae9f-011f7031f1f3', '53f71fee-58d5-4bbd-8d18-f55dda0a0428', '95f19754-8778-42e7-a232-108e0e267378', 'f70bd9d7-b61b-4621-b2ac-5811c6957482'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.160s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:44:29 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Deleted volume successfully. Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "cinder-1fd3426b-db56-4785-84a5-fb92a2088fea-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4478670c-f85e-46d8-bdc5-b198867dbda8 tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "cinder-87d48039-d9f4-4394-a75c-7fd41b44bba5-delete_volume" released by "delete_volume" :: held 4.289s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "cinder-1fd3426b-db56-4785-84a5-fb92a2088fea-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "cinder-quobyte-1fd3426b-db56-4785-84a5-fb92a2088fea" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "cinder-quobyte-1fd3426b-db56-4785-84a5-fb92a2088fea" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:30 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c132608-8705-4d92-9465-e0ad0df5e9a2]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea" returned: 0 in 0.506s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0fde851a-0791-4fc2-9d5f-56abab10784e tempest-VolumesTransfersTest-1515468675 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1fd3426b-db56-4785-84a5-fb92a2088fea" returned: 0 in 0.506s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:31 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0fde851a-0791-4fc2-9d5f-56abab10784e tempest-VolumesTransfersTest-1515468675 None] Transfer volume completed successfully. Sep 18 11:44:31 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Flow 'volume_create_manager' (4223fd32-4cc9-47d4-a563-5af26e988e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b21448a-f4ce-4a90-94a0-038cf3d40e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "cinder-quobyte-1fd3426b-db56-4785-84a5-fb92a2088fea" released by "delete_volume" :: held 1.226s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b21448a-f4ce-4a90-94a0-038cf3d40e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1302936817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99de1d17-e10c-4492-997a-615d91ad7052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48fa448a79f24c87ba594b4ef95c3e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:31Z,use_quota=True,user_id='dd04dfe68f144d319463a894672aa27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f03efe-f91a-4ee5-8421-fe2a2835cc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f03efe-f91a-4ee5-8421-fe2a2835cc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699125da-71af-4faf-9f47-0192b986b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699125da-71af-4faf-9f47-0192b986b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99de1d17-e10c-4492-997a-615d91ad7052', 'volume_name': 'volume-99de1d17-e10c-4492-997a-615d91ad7052', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0390f175-4c82-4ed7-a4e3-bcc574f78f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0390f175-4c82-4ed7-a4e3-bcc574f78f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0ce719-a16e-4faa-b31b-94ee796fd368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:31 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Volume 99de1d17-e10c-4492-997a-615d91ad7052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99de1d17-e10c-4492-997a-615d91ad7052', 'volume_size': 1} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1302936817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99de1d17-e10c-4492-997a-615d91ad7052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48fa448a79f24c87ba594b4ef95c3e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:31Z,use_quota=True,user_id='dd04dfe68f144d319463a894672aa27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Creating volume 99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:44:31 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:31 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=71, name=volume-99de1d17-e10c-4492-997a-615d91ad7052, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 1073741824" returned: 0 in 0.406s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052" returned: 0 in 0.283s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] <== create_volume: return (756ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0ce719-a16e-4faa-b31b-94ee796fd368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99de1d17-e10c-4492-997a-615d91ad7052', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fa2492-9afb-431a-a888-2664e04675ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Created reservations ['9f4860e9-5083-4aac-a630-1e561ac6e2df', 'c9738182-5647-4598-a2e2-29d4a3bd6ff2', '9feccb23-898b-421f-bd1a-24f622155626', '68902dbb-1fac-4f84-95f5-73acf0ba4ecb'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:44:32 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Volume volume-99de1d17-e10c-4492-997a-615d91ad7052 (99de1d17-e10c-4492-997a-615d91ad7052): created successfully Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fa2492-9afb-431a-a888-2664e04675ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Flow 'volume_create_manager' (4223fd32-4cc9-47d4-a563-5af26e988e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:32 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5292e1f8-571f-4475-af90-18484bce169f tempest-SnapshotDependencyTests-109288448 None] Created volume successfully. Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Acquiring lock "cinder-5fbfc4b9-584b-4b5e-9e52-d552d7318212-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.159s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:44:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Lock "cinder-5fbfc4b9-584b-4b5e-9e52-d552d7318212-delete_volume" acquired by "delete_volume" :: waited 0.284s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:32 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Deleted volume successfully. Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-40dc9267-e0b9-4376-9766-3101c4a52e7d tempest-AttachVolumeShelveTestJSON-442706181 None] Lock "cinder-1fd3426b-db56-4785-84a5-fb92a2088fea-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:33 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Acquiring lock "cinder-quobyte-5fbfc4b9-584b-4b5e-9e52-d552d7318212" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Lock "cinder-quobyte-5fbfc4b9-584b-4b5e-9e52-d552d7318212" acquired by "delete_volume" :: waited 0.026s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[518471ff-fcfe-4a61-8b50-10bcd6b5741c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:33 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Creating offline snapshot 2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 of volume 99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212" returned: 0 in 0.699s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:33 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d89bab-e1de-4dbc-a5e7-1cbf142a0d5c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5fbfc4b9-584b-4b5e-9e52-d552d7318212" returned: 0 in 0.212s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Lock "cinder-quobyte-5fbfc4b9-584b-4b5e-9e52-d552d7318212" released by "delete_volume" :: held 1.094s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:34 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Created reservations ['5dabfa0e-a7d2-48d2-9811-360cd6e56466', '4ba028e9-143a-4a7f-93c3-fefba93e925f', '09f976d9-d77a-4f27-9887-d18354159735', '3b1e6417-dbd7-4178-b1da-1c7b81e714a2'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:44:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052" returned: 0 in 0.689s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:35 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=72, name=volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 1G" returned: 0 in 0.553s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): qemu-img rebase -u -b volume-99de1d17-e10c-4492-997a-615d91ad7052 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] CMD "qemu-img rebase -u -b volume-99de1d17-e10c-4492-997a-615d91ad7052 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" returned: 0 in 0.248s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" returned: 0 in 0.283s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:44:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.228s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:36 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:44:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Deleted volume successfully. Sep 18 11:44:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" returned: 0 in 0.570s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0ba020b2-db34-4b14-bbcf-7dc90710a9f8 tempest-VolumesTransfersTest-1006170056 None] Lock "cinder-5fbfc4b9-584b-4b5e-9e52-d552d7318212-delete_volume" released by "delete_volume" :: held 4.213s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.info" returned: 0 in 0.570s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Flow 'volume_create_manager' (944515c1-647d-4ff9-ac61-a5dcd4f8ac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e826e2a-8b7e-41b2-a816-d2b94150a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e826e2a-8b7e-41b2-a816-d2b94150a62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1643106720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0edc450-9e48-4d0f-b3af-789f40e7fe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f198dca60e64a13bdf8d5bf9d99d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:36Z,use_quota=True,user_id='8b0e2559293b4d97b95bb9ac3037c474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1b7158-f884-4c11-89c1-599aaf203630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1b7158-f884-4c11-89c1-599aaf203630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006ad23c-38da-41ab-93c4-b8819f5b9195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006ad23c-38da-41ab-93c4-b8819f5b9195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0edc450-9e48-4d0f-b3af-789f40e7fe17', 'volume_name': 'volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bacb4f-a733-4c24-af79-82a12659ecf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bacb4f-a733-4c24-af79-82a12659ecf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7570761-e969-44b3-afcb-d29174b3c10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:37 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Volume e0edc450-9e48-4d0f-b3af-789f40e7fe17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17', 'volume_size': 1} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.info" returned: 0 in 0.328s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.840s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1643106720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0edc450-9e48-4d0f-b3af-789f40e7fe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f198dca60e64a13bdf8d5bf9d99d772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:36Z,use_quota=True,user_id='8b0e2559293b4d97b95bb9ac3037c474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Creating volume e0edc450-9e48-4d0f-b3af-789f40e7fe17 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:44:37 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:44:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:37 devstack quobyte-client[83210]: System call of process 92571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:44:38 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=74, name=volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:44:38 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-45a25617-49de-46b1-890a-8c5f08c27e45 tempest-SnapshotDependencyTests-109288448 None] Create snapshot completed successfully Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17 1073741824" returned: 0 in 0.531s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17" returned: 0 in 0.153s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] <== create_volume: return (747ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7570761-e969-44b3-afcb-d29174b3c10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df771d4-57e4-46f2-b1b3-117d26283521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:38 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Volume volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17 (e0edc450-9e48-4d0f-b3af-789f40e7fe17): created successfully Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df771d4-57e4-46f2-b1b3-117d26283521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Flow 'volume_create_manager' (944515c1-647d-4ff9-ac61-a5dcd4f8ac6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:38 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-46d1a401-e773-4dbf-b76d-7adfda8c2dd7 tempest-VolumesTransfersTest-88919376 None] Created volume successfully. Sep 18 11:44:39 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:39 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Flow 'volume_create_manager' (ebd2fd89-c4e7-46af-9d93-8ee4ec9097a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb772ed-cad7-4709-82ee-e8923f554f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb772ed-cad7-4709-82ee-e8923f554f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48fa448a79f24c87ba594b4ef95c3e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:44:40Z,use_quota=True,user_id='dd04dfe68f144d319463a894672aa27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3355b556-5d80-4b81-9396-d442571d103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3355b556-5d80-4b81-9396-d442571d103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5655e3f-4998-4ddb-950d-916d7116dff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5655e3f-4998-4ddb-950d-916d7116dff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b', 'volume_name': 'volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b', 'volume_size': 1, 'snapshot_id': '2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1'}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db4bc69-6207-481e-900e-3d6d755a6353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db4bc69-6207-481e-900e-3d6d755a6353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b2117d-0b19-4c94-b1cd-6ca3d4e8dd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:40 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Volume f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b', 'volume_size': 1, 'snapshot_id': '2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1'} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-quobyte-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" by "_create_volume_from_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Acquiring lock "cinder-e0edc450-9e48-4d0f-b3af-789f40e7fe17-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Creating volume f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b from snapshot 2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-quobyte-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" by "_copy_volume_from_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Lock "cinder-e0edc450-9e48-4d0f-b3af-789f40e7fe17-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] snapshot: 2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1, volume: f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b, {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ac29d-be47-4de5-8e52-27e1df6a3a4f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:40 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Acquiring lock "cinder-quobyte-e0edc450-9e48-4d0f-b3af-789f40e7fe17" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Lock "cinder-quobyte-e0edc450-9e48-4d0f-b3af-789f40e7fe17" acquired by "delete_volume" :: waited 0.078s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9233249-4639-41e2-9fc4-bd6e014f0785]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:40 devstack quobyte-client[83210]: System call of process 92575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" returned: 0 in 0.779s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99de1d17-e10c-4492-997a-615d91ad7052(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Creating direct copy from snapshot {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6499b13a-5f8f-43c9-8aaa-99c418ff8d52]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17" returned: 0 in 0.828s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-e0edc450-9e48-4d0f-b3af-789f40e7fe17" returned: 0 in 0.162s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052" returned: 0 in 0.709s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG cinder.utils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b not found in is_blk_device check {{(pid=83184) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 18 11:44:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Lock "cinder-quobyte-e0edc450-9e48-4d0f-b3af-789f40e7fe17" released by "delete_volume" :: held 1.308s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:42 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=75, name=volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:44:42 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Created reservations ['c42ff273-1f56-4f0f-af79-d60f0533b65e', 'b3eeecf2-8b7b-4a48-a9af-f38dea34daf6', '2c593b0d-dc0c-4067-b26b-115d184bee6c', 'cd4db53c-10e0-4f86-a5d6-111c3abf39f0'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:44:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.379s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:43 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:44:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Deleted volume successfully. Sep 18 11:44:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:44:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-748c9a2d-570a-4112-a3cb-ac1f64f3db44 tempest-VolumesTransfersTest-1006170056 None] Lock "cinder-e0edc450-9e48-4d0f-b3af-789f40e7fe17-delete_volume" released by "delete_volume" :: held 5.400s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 1.453s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:44:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" returned: 0 in 7.946s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:49 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dba933-2e2a-4457-b530-4aee695ad308]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052" returned: 0 in 0.795s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:50 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Image conversion details: src /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 11:44:50 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Converted 1024.00 MB image at 128.76 MB/s Sep 18 11:44:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:44:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" returned: 0 in 0.135s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" released by "_copy_volume_from_snapshot" :: held 10.955s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" released by "_create_volume_from_snapshot" :: held 11.017s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.073s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b2117d-0b19-4c94-b1cd-6ca3d4e8dd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b', 'volume_size': 1, 'snapshot_id': '2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1'}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3ab000-063b-46f3-9193-d70483e94b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:44:51 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Volume volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b (f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b): created successfully Sep 18 11:44:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3ab000-063b-46f3-9193-d70483e94b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:44:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Flow 'volume_create_manager' (ebd2fd89-c4e7-46af-9d93-8ee4ec9097a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:44:51 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ef16bf19-5fed-40cf-ab8d-7e26ae640a05 tempest-SnapshotDependencyTests-109288448 None] Created volume successfully. Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-quobyte-99de1d17-e10c-4492-997a-615d91ad7052" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-99de1d17-e10c-4492-997a-615d91ad7052" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-quobyte-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Deleting offline snapshot 2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 of volume 99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] snapshot_file for this snap is: volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b54d22-db25-408b-9426-8e02af91e8dd]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" returned: 0 in 0.550s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99de1d17-e10c-4492-997a-615d91ad7052(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:44:53 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8914b62d-7097-4484-ab0f-b11f2f8c37e1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052" returned: 0 in 0.683s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:54 devstack quobyte-client[83210]: System call of process 92612 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:44:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" returned: 0 in 0.345s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052.2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" returned: 0 in 0.145s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1" released by "_delete_snapshot" :: held 2.052s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-99de1d17-e10c-4492-997a-615d91ad7052" released by "delete_snapshot" :: held 2.081s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:55 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Created reservations ['e2f160f8-ac87-4566-97a6-35675698eac9', '2b93beaa-1419-4c3d-a097-6ea05c70225f', 'c0182b79-ee17-49d1-a07a-224bcff0a9a7', '071f2c4f-ea77-4f81-abf4-49001f0289ba'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:44:55 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Delete snapshot completed successfully. Sep 18 11:44:55 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b452510a-de28-4c37-b09b-810be551908e tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-2d04ff4d-32e2-43b3-a0c1-0d071f8b99c1-delete_snapshot" released by "delete_snapshot" :: held 3.221s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-99de1d17-e10c-4492-997a-615d91ad7052-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-99de1d17-e10c-4492-997a-615d91ad7052-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-quobyte-99de1d17-e10c-4492-997a-615d91ad7052" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-99de1d17-e10c-4492-997a-615d91ad7052" acquired by "delete_volume" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef857d2-6c27-4923-89ce-1c8405ea0d7c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052" returned: 0 in 0.495s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-99de1d17-e10c-4492-997a-615d91ad7052" returned: 0 in 0.137s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-99de1d17-e10c-4492-997a-615d91ad7052" released by "delete_volume" :: held 0.837s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Created reservations ['91dd1737-c401-412f-b4b6-77320e345c26', '3ba19c7b-0cfa-4cb1-b7f1-ad5d9f5e8569', 'ad46af4f-56f3-43ca-afad-fffc7303534d', '7912ee90-dbca-46e2-85d9-53740db845aa'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.121s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:57 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:44:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Deleted volume successfully. Sep 18 11:44:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3f34ccb0-aaed-49b2-9f06-344efe6dcc51 tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-99de1d17-e10c-4492-997a-615d91ad7052-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:44:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:58 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=49,cinder:UPDATE=73,cinder:DELETE=10,cinder:INSERT=15 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:44:58 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:44:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "cinder-quobyte-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:44:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:44:58 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fe5437-fe81-4e81-9095-5efd194ae5ab]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:44:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" returned: 0 in 0.731s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:44:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:44:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" returned: 0 in 0.234s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-quobyte-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b" released by "delete_volume" :: held 1.227s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=70,cinder:SELECT=52,cinder:INSERT=17,cinder:DELETE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Created reservations ['e382f6cc-fbc1-44d5-943e-7ace500174a2', '930b8f4a-86c9-4fa7-9319-077bec48697c', '2d8c9d2a-ee20-42a9-91fc-732fb30a1816', '4860c5d1-dc61-4e4c-9c17-b21d855f2de0'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.306s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:01 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:45:01 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Deleted volume successfully. Sep 18 11:45:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dc9a54b1-0be7-49f0-ac45-5fc4865318be tempest-SnapshotDependencyTests-109288448 None] Lock "cinder-f34a1c6a-c9a1-49ae-9c8d-e2c0b589d56b-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:02 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Flow 'volume_create_manager' (fe6fe252-ff06-496b-8ea8-25354a91f3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc8b673-a21d-4d99-a6b2-aadf7bfbfb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc8b673-a21d-4d99-a6b2-aadf7bfbfb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-178193510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e067a3-d86d-4e7c-81ba-551b03df8ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1984faa9c3e8492788df58805e797809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:02Z,use_quota=True,user_id='9ad2dc22948c486995ef4bc717822fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbf441b-c82c-4583-8758-e2a9a3a8812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbf441b-c82c-4583-8758-e2a9a3a8812f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9692a73-41b8-413a-9e4b-4b862c2c7884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9692a73-41b8-413a-9e4b-4b862c2c7884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e067a3-d86d-4e7c-81ba-551b03df8ea3', 'volume_name': 'volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f67d23-c898-4a82-96cf-305da13d3d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f67d23-c898-4a82-96cf-305da13d3d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9689047a-87b1-4144-a4ae-9b1e469da346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Volume 79e067a3-d86d-4e7c-81ba-551b03df8ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3', 'volume_size': 1} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-178193510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e067a3-d86d-4e7c-81ba-551b03df8ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1984faa9c3e8492788df58805e797809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:02Z,use_quota=True,user_id='9ad2dc22948c486995ef4bc717822fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Creating volume 79e067a3-d86d-4e7c-81ba-551b03df8ea3 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:45:02 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:45:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:03 devstack quobyte-client[83210]: System call of process 92635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:45:03 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=76, name=volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:45:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3 1073741824" returned: 0 in 0.694s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3" returned: 0 in 0.160s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] <== create_volume: return (964ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:45:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9689047a-87b1-4144-a4ae-9b1e469da346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb78655c-a2df-4fb7-a28d-df89d70f92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:04 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Volume volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3 (79e067a3-d86d-4e7c-81ba-551b03df8ea3): created successfully Sep 18 11:45:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb78655c-a2df-4fb7-a28d-df89d70f92d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Flow 'volume_create_manager' (fe6fe252-ff06-496b-8ea8-25354a91f3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-886a6717-4043-4f10-a7bb-6d56c32bca02 tempest-VolumesTransfersV355Test-1922641667 None] Created volume successfully. Sep 18 11:45:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2e86c504-96d4-43f3-8b62-6fdbdcd508b5 tempest-VolumesTransfersV355Test-70008704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2e86c504-96d4-43f3-8b62-6fdbdcd508b5 tempest-VolumesTransfersV355Test-70008704 None] Transfer volume completed successfully. Sep 18 11:45:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Acquiring lock "cinder-79e067a3-d86d-4e7c-81ba-551b03df8ea3-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:45:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Lock "cinder-79e067a3-d86d-4e7c-81ba-551b03df8ea3-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:45:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Acquiring lock "cinder-quobyte-79e067a3-d86d-4e7c-81ba-551b03df8ea3" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:45:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Lock "cinder-quobyte-79e067a3-d86d-4e7c-81ba-551b03df8ea3" acquired by "delete_volume" :: waited 0.061s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:45:07 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[36571423-72b6-4eb7-bb03-ac7875497616]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:08 devstack quobyte-client[83210]: System call of process 92643 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:45:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3" returned: 0 in 1.024s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-79e067a3-d86d-4e7c-81ba-551b03df8ea3" returned: 0 in 0.199s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Lock "cinder-quobyte-79e067a3-d86d-4e7c-81ba-551b03df8ea3" released by "delete_volume" :: held 1.687s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Created reservations ['cd47b3ee-3a9b-4e52-ac02-fd320ee00a31', 'db703bf8-6f76-46f8-b0f5-711d62ce1b2a', '0db57bf0-c8bf-4578-81b8-d2a9982c6fb5', '5b718729-d135-4a05-aef3-1ffe2d8625b5'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.177s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:10 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:45:10 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Deleted volume successfully. Sep 18 11:45:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6ac2ddf6-78a5-428d-be74-eaa383afe737 tempest-VolumesTransfersV355Test-905760127 None] Lock "cinder-79e067a3-d86d-4e7c-81ba-551b03df8ea3-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:11 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:11 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Flow 'volume_create_manager' (bd14727e-0fa0-45b1-aff8-2c06d19a06aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64061ea8-b580-428e-8c2a-668ba8bf8bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64061ea8-b580-428e-8c2a-668ba8bf8bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-617154097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061af54b-cec0-4ad7-aaff-2fdfe3571812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1984faa9c3e8492788df58805e797809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:12Z,use_quota=True,user_id='9ad2dc22948c486995ef4bc717822fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec00093-d9dc-409f-a3fb-1e2273b93036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec00093-d9dc-409f-a3fb-1e2273b93036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4d1a42-78a9-4b53-a599-6103737963ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4d1a42-78a9-4b53-a599-6103737963ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061af54b-cec0-4ad7-aaff-2fdfe3571812', 'volume_name': 'volume-061af54b-cec0-4ad7-aaff-2fdfe3571812', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da287266-94a2-4f27-bc7b-97ed4c72f6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da287266-94a2-4f27-bc7b-97ed4c72f6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b3accc-4c82-4817-8fd6-87a76d77f8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:12 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Volume 061af54b-cec0-4ad7-aaff-2fdfe3571812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061af54b-cec0-4ad7-aaff-2fdfe3571812', 'volume_size': 1} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-617154097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061af54b-cec0-4ad7-aaff-2fdfe3571812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1984faa9c3e8492788df58805e797809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:12Z,use_quota=True,user_id='9ad2dc22948c486995ef4bc717822fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Creating volume 061af54b-cec0-4ad7-aaff-2fdfe3571812 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:45:12 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-061af54b-cec0-4ad7-aaff-2fdfe3571812 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:12 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=77, name=volume-061af54b-cec0-4ad7-aaff-2fdfe3571812, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-061af54b-cec0-4ad7-aaff-2fdfe3571812 1073741824" returned: 0 in 0.477s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-061af54b-cec0-4ad7-aaff-2fdfe3571812 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-061af54b-cec0-4ad7-aaff-2fdfe3571812" returned: 0 in 0.181s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] <== create_volume: return (742ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:45:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b3accc-4c82-4817-8fd6-87a76d77f8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061af54b-cec0-4ad7-aaff-2fdfe3571812', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378c04dd-7de8-49f8-b9a3-f7becb1a33a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:13 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Volume volume-061af54b-cec0-4ad7-aaff-2fdfe3571812 (061af54b-cec0-4ad7-aaff-2fdfe3571812): created successfully Sep 18 11:45:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378c04dd-7de8-49f8-b9a3-f7becb1a33a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Flow 'volume_create_manager' (bd14727e-0fa0-45b1-aff8-2c06d19a06aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:13 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3275f5ab-68ca-42cc-aa9f-297e7eac01f2 tempest-VolumesTransfersV355Test-1922641667 None] Created volume successfully. Sep 18 11:45:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Acquiring lock "cinder-061af54b-cec0-4ad7-aaff-2fdfe3571812-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:45:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Lock "cinder-061af54b-cec0-4ad7-aaff-2fdfe3571812-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:45:14 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Acquiring lock "cinder-quobyte-061af54b-cec0-4ad7-aaff-2fdfe3571812" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:45:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Lock "cinder-quobyte-061af54b-cec0-4ad7-aaff-2fdfe3571812" acquired by "delete_volume" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:45:14 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0e9340-5697-4191-b205-1336752c9fe1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-061af54b-cec0-4ad7-aaff-2fdfe3571812 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-061af54b-cec0-4ad7-aaff-2fdfe3571812" returned: 0 in 0.542s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-061af54b-cec0-4ad7-aaff-2fdfe3571812 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-061af54b-cec0-4ad7-aaff-2fdfe3571812" returned: 0 in 0.132s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Lock "cinder-quobyte-061af54b-cec0-4ad7-aaff-2fdfe3571812" released by "delete_volume" :: held 0.906s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Created reservations ['fba78fdb-991f-4817-b7da-95902634c104', 'c4418245-d985-4f89-968c-2212b5e62a79', 'ef04774d-e589-456e-88e1-155665e5ddc3', 'd2df47bf-61aa-4a39-8411-b3a68021bc00'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.154s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:45:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Deleted volume successfully. Sep 18 11:45:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5d267743-7704-49b4-9012-6c9bd087996e tempest-VolumesTransfersV355Test-905760127 None] Lock "cinder-061af54b-cec0-4ad7-aaff-2fdfe3571812-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:26 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=31,cinder:SELECT=14,cinder:DELETE=4,cinder:INSERT=6 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:45:26 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:45:28 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Flow 'volume_create_manager' (c7fe46aa-6eba-4d5f-9fef-a7d7ec78914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61decba-b6c8-4790-96c5-a7ea8dcaee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61decba-b6c8-4790-96c5-a7ea8dcaee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1886359249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d931af86-cfc9-4f07-ab30-cce4de0800b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6e8cad3be54798a95358b39012c076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:28Z,use_quota=True,user_id='cbe5086fbf424a17b7afecbcf17af0a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e0d917-d76f-4f77-be29-021826b98ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e0d917-d76f-4f77-be29-021826b98ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed39d169-c3b7-4fd1-9322-96e62eeba70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed39d169-c3b7-4fd1-9322-96e62eeba70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd931af86-cfc9-4f07-ab30-cce4de0800b0', 'volume_name': 'volume-d931af86-cfc9-4f07-ab30-cce4de0800b0', 'volume_size': 2}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90ef0f0-c680-4d41-8069-a87d36755f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90ef0f0-c680-4d41-8069-a87d36755f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b795f33b-3804-4913-b4a3-b8f402a1a689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:28 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Volume d931af86-cfc9-4f07-ab30-cce4de0800b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d931af86-cfc9-4f07-ab30-cce4de0800b0', 'volume_size': 2} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1886359249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d931af86-cfc9-4f07-ab30-cce4de0800b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6e8cad3be54798a95358b39012c076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:28Z,use_quota=True,user_id='cbe5086fbf424a17b7afecbcf17af0a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Creating volume d931af86-cfc9-4f07-ab30-cce4de0800b0 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:45:28 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:45:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d931af86-cfc9-4f07-ab30-cce4de0800b0 2147483648 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:29 devstack quobyte-client[83210]: System call of process 92701 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:45:29 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=78, name=volume-d931af86-cfc9-4f07-ab30-cce4de0800b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:45:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d931af86-cfc9-4f07-ab30-cce4de0800b0 2147483648" returned: 0 in 0.812s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d931af86-cfc9-4f07-ab30-cce4de0800b0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d931af86-cfc9-4f07-ab30-cce4de0800b0" returned: 0 in 0.222s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:29 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] <== create_volume: return (1146ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:45:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b795f33b-3804-4913-b4a3-b8f402a1a689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d931af86-cfc9-4f07-ab30-cce4de0800b0', 'volume_size': 2}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d09ada-cac6-4093-b26b-b58f7e9dda68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:30 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Volume volume-d931af86-cfc9-4f07-ab30-cce4de0800b0 (d931af86-cfc9-4f07-ab30-cce4de0800b0): created successfully Sep 18 11:45:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d09ada-cac6-4093-b26b-b58f7e9dda68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Flow 'volume_create_manager' (c7fe46aa-6eba-4d5f-9fef-a7d7ec78914e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:30 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-19b534c0-b74d-4986-af2a-492db99e7ff2 tempest-VolumesCloneNegativeTest-687053394 None] Created volume successfully. Sep 18 11:45:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Acquiring lock "cinder-d931af86-cfc9-4f07-ab30-cce4de0800b0-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:45:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Lock "cinder-d931af86-cfc9-4f07-ab30-cce4de0800b0-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:45:32 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Acquiring lock "cinder-quobyte-d931af86-cfc9-4f07-ab30-cce4de0800b0" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:45:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Lock "cinder-quobyte-d931af86-cfc9-4f07-ab30-cce4de0800b0" acquired by "delete_volume" :: waited 0.029s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:45:32 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeac55f-a126-4256-8a93-0f399491b8a0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d931af86-cfc9-4f07-ab30-cce4de0800b0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d931af86-cfc9-4f07-ab30-cce4de0800b0" returned: 0 in 0.453s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d931af86-cfc9-4f07-ab30-cce4de0800b0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d931af86-cfc9-4f07-ab30-cce4de0800b0" returned: 0 in 0.126s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Lock "cinder-quobyte-d931af86-cfc9-4f07-ab30-cce4de0800b0" released by "delete_volume" :: held 0.761s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Created reservations ['6579c18e-3ba5-4f15-ab68-761766f8eb87', 'cb0d0614-d668-4445-88d9-d09e8dd899f2', '7c7dc3d3-b4f1-415b-ad5b-c98241732f73', '527f1ff1-0b33-428f-a7fb-605f9548c777'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.099s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:45:33 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Deleted volume successfully. Sep 18 11:45:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5fbdbc76-3f6c-416f-8c54-9784a9d16d73 tempest-VolumesCloneNegativeTest-687053394 None] Lock "cinder-d931af86-cfc9-4f07-ab30-cce4de0800b0-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:37 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:45:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Flow 'volume_create_manager' (20e1cbbc-458b-4b3b-8dd4-84285936a594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1327a2c1-4c6a-410e-be56-35ed35820530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1327a2c1-4c6a-410e-be56-35ed35820530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-953400106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80fe168-4d5f-43a2-a9e5-22543d77efbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5fc49d6b894a9a99b9baaa2991456a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:38Z,use_quota=True,user_id='87cb78d161c145898a1f291c7eb5d7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2196783c-5bcd-41a2-aa4b-a7582dca82ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2196783c-5bcd-41a2-aa4b-a7582dca82ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8ae6ac-2ff9-48a3-9d4c-788e27ca3e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:37 devstack cinder-volume[83184]: DEBUG cinder.image.glance [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Creating Keystone auth plugin from conf {{(pid=83184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 18 11:45:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8ae6ac-2ff9-48a3-9d4c-788e27ca3e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b80fe168-4d5f-43a2-a9e5-22543d77efbd', 'volume_name': 'volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b44aa1-bb2f-430d-9516-8f6e2dd7f00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b44aa1-bb2f-430d-9516-8f6e2dd7f00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3b3559-4f60-470d-af75-0aaec4c63550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:38 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Volume b80fe168-4d5f-43a2-a9e5-22543d77efbd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 11:45:38 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Cloning b80fe168-4d5f-43a2-a9e5-22543d77efbd from image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]). {{(pid=83184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 18 11:45:38 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 18 11:45:38 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Image download 20.69 MB at 20.69 MB/s Sep 18 11:45:39 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bc7677-5853-4cc9-be11-5e7016f85f31]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:39 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD Sep 18 11:45:39 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:45:43 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Sep 18 11:45:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD" returned: 0 in 4.222s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:43 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Temporary image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 is fetched for user 87cb78d161c145898a1f291c7eb5d7e6. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 18 11:45:43 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[891440b3-24cc-4eff-8058-a176412d9384]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:44 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:44 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.096s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.230s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:45:46 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD" returned: 0 in 2.662s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-953400106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80fe168-4d5f-43a2-a9e5-22543d77efbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5fc49d6b894a9a99b9baaa2991456a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:45:38Z,use_quota=True,user_id='87cb78d161c145898a1f291c7eb5d7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Creating volume b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:45:46 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:46 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=79, name=volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd 1073741824" returned: 0 in 0.391s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 0 in 0.113s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] <== create_volume: return (579ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:45:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.607s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:47 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Attempting download of 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}])) to volume b80fe168-4d5f-43a2-a9e5-22543d77efbd. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 18 11:45:47 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[537bb371-322f-4dbb-87ab-fdd872ab7091]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_u43mhzso {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_u43mhzso" returned: 0 in 0.389s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_u43mhzso {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_u43mhzso" returned: 1 in 0.398s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_u43mhzso' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:45:48 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c0b3a7-ac71-4545-8609-1df84df2bf31]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:48 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 was qcow2, converting to raw {{(pid=83184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 18 11:45:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:48 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=79, name=volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:45:48 devstack quobyte-client[83210]: System call of process 92825 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:45:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 0 in 0.932s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:49 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_ov57t8z2devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 11:45:49 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Converted 112.00 MB image at 112.00 MB/s Sep 18 11:45:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd 1G" returned: 0 in 0.162s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:50 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b46819-dd95-44f5-9907-b07d5230bc70]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 0 in 0.517s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 1 in 0.708s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:45:51 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Downloaded image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}])) to volume b80fe168-4d5f-43a2-a9e5-22543d77efbd successfully. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 18 11:45:51 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Temporary image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 for user 87cb78d161c145898a1f291c7eb5d7e6 is deleted. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 18 11:45:51 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Marking volume b80fe168-4d5f-43a2-a9e5-22543d77efbd as bootable. {{(pid=83184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 18 11:45:51 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Copying metadata from image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 to b80fe168-4d5f-43a2-a9e5-22543d77efbd. {{(pid=83184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 11:45:51 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Creating volume glance metadata for volume b80fe168-4d5f-43a2-a9e5-22543d77efbd backed by image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 11:45:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3b3559-4f60-470d-af75-0aaec4c63550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064359e3-b478-435c-94a4-766271b7acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:45:52 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Volume volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd (b80fe168-4d5f-43a2-a9e5-22543d77efbd): created successfully Sep 18 11:45:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064359e3-b478-435c-94a4-766271b7acd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:45:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Flow 'volume_create_manager' (20e1cbbc-458b-4b3b-8dd4-84285936a594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a4984efa-54c8-47f9-8c3b-5ca6b298db21 tempest-VolumesExtendTest-2091688887 None] Created volume successfully. Sep 18 11:45:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:53 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0aec2e-74df-4c6e-a9fc-3c22fefc7461]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 0 in 0.558s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:54 devstack quobyte-client[83210]: System call of process 92847 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:45:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 1 in 0.571s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:45:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd 2G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:54 devstack quobyte-client[83210]: System call of process 92850 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:45:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd 2G" returned: 0 in 0.251s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.713s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:55 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b1aa8a85-4268-49ac-8534-0857e8279ec2 tempest-VolumesExtendTest-2091688887 None] Extend volume completed successfully. Sep 18 11:45:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "cinder-b80fe168-4d5f-43a2-a9e5-22543d77efbd-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:45:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Lock "cinder-b80fe168-4d5f-43a2-a9e5-22543d77efbd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:45:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "cinder-quobyte-b80fe168-4d5f-43a2-a9e5-22543d77efbd" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:45:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Lock "cinder-quobyte-b80fe168-4d5f-43a2-a9e5-22543d77efbd" acquired by "delete_volume" :: waited 0.010s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:45:56 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0f0286-5a62-4f2b-adc3-5aca4b7d5d48]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:45:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 0 in 0.420s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 1 in 0.503s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:45:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b80fe168-4d5f-43a2-a9e5-22543d77efbd" returned: 0 in 0.106s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Lock "cinder-quobyte-b80fe168-4d5f-43a2-a9e5-22543d77efbd" released by "delete_volume" :: held 1.306s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Created reservations ['d991cd03-5d50-4306-a6d1-2b7d4089fa8b', '0a7f3f9a-e38b-4d3d-8191-9fa0f12dcc41', '1595d064-6ce3-443b-aebc-5b7cee666214', '12b2e455-2295-4cee-8768-d37ea8204979'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:45:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.272s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:45:59 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:45:59 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Deleted volume successfully. Sep 18 11:45:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b527823d-04f8-4fed-956d-879970f95322 tempest-VolumesExtendTest-2091688887 None] Lock "cinder-b80fe168-4d5f-43a2-a9e5-22543d77efbd-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:45:59 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:45:59 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:45:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Flow 'volume_create_manager' (4ebe40cf-9759-4304-8c66-1c2033375c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:45:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad53a9f-8434-42c6-bb14-3f6995965eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad53a9f-8434-42c6-bb14-3f6995965eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-825118234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e2edc8-a240-4c46-aede-faf13ce38b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5fc49d6b894a9a99b9baaa2991456a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:00Z,use_quota=True,user_id='87cb78d161c145898a1f291c7eb5d7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afc8caa-3537-4e0b-a5e7-496dbaf1155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afc8caa-3537-4e0b-a5e7-496dbaf1155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a278c8-08e2-4cd5-8ff8-1c59b8e4ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a278c8-08e2-4cd5-8ff8-1c59b8e4ec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e2edc8-a240-4c46-aede-faf13ce38b51', 'volume_name': 'volume-c0e2edc8-a240-4c46-aede-faf13ce38b51', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bad08e-266e-40c3-b24c-475e78cf7c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bad08e-266e-40c3-b24c-475e78cf7c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0df2c45-a693-4966-983b-5dc878a2eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:00 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Volume c0e2edc8-a240-4c46-aede-faf13ce38b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e2edc8-a240-4c46-aede-faf13ce38b51', 'volume_size': 1} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-825118234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e2edc8-a240-4c46-aede-faf13ce38b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5fc49d6b894a9a99b9baaa2991456a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:00Z,use_quota=True,user_id='87cb78d161c145898a1f291c7eb5d7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Creating volume c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:46:00 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:00 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=80, name=volume-c0e2edc8-a240-4c46-aede-faf13ce38b51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 1073741824" returned: 0 in 0.415s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51" returned: 0 in 0.095s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] <== create_volume: return (605ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0df2c45-a693-4966-983b-5dc878a2eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e2edc8-a240-4c46-aede-faf13ce38b51', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e05ec83-4879-4a30-a343-25c34117c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:00 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Volume volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 (c0e2edc8-a240-4c46-aede-faf13ce38b51): created successfully Sep 18 11:46:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e05ec83-4879-4a30-a343-25c34117c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Flow 'volume_create_manager' (4ebe40cf-9759-4304-8c66-1c2033375c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:01 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a786b1b4-5353-4e9a-92ca-37ce363bc52b tempest-VolumesExtendTest-2091688887 None] Created volume successfully. Sep 18 11:46:02 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Creating offline snapshot b8fc0799-438e-4be2-8ec1-2f721dc79016 of volume c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:46:02 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d1457-1718-4412-93d3-cf18b3af0738]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:46:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51" returned: 0 in 0.566s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:03 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=81, name=volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 1G" returned: 0 in 0.283s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img rebase -u -b volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016" returned: 0 in 0.189s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016" returned: 0 in 0.110s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016" returned: 0 in 0.110s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.info" returned: 0 in 0.112s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:46:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.info" returned: 0 in 0.109s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-82b994e9-ac89-42a0-83ed-7a4d7f62401f tempest-VolumesExtendTest-2091688887 None] Create snapshot completed successfully Sep 18 11:46:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:05 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f03cdf-b6ad-414f-bfe5-f3ca367136b9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:46:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51" returned: 0 in 0.438s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 2G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 2G" returned: 0 in 0.256s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.783s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:06 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-947ffbb0-b590-4343-b145-882e5620571d tempest-VolumesExtendTest-2091688887 None] Extend volume completed successfully. Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Acquiring lock "cinder-b8fc0799-438e-4be2-8ec1-2f721dc79016-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Lock "cinder-b8fc0799-438e-4be2-8ec1-2f721dc79016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:08 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Acquiring lock "cinder-quobyte-c0e2edc8-a240-4c46-aede-faf13ce38b51" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Lock "cinder-quobyte-c0e2edc8-a240-4c46-aede-faf13ce38b51" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Acquiring lock "cinder-quobyte-b8fc0799-438e-4be2-8ec1-2f721dc79016" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Lock "cinder-quobyte-b8fc0799-438e-4be2-8ec1-2f721dc79016" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Deleting offline snapshot b8fc0799-438e-4be2-8ec1-2f721dc79016 of volume c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] snapshot_file for this snap is: volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[46926209-8acb-4f11-a748-51a7efa37a7e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:08 devstack quobyte-client[83210]: System call of process 92900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016" returned: 0 in 0.511s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0e2edc8-a240-4c46-aede-faf13ce38b51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c92f433-948d-4bc8-84a2-794f10cebe2a]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:46:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51" returned: 0 in 0.424s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016" returned: 0 in 0.313s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51.b8fc0799-438e-4be2-8ec1-2f721dc79016" returned: 0 in 0.127s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Lock "cinder-quobyte-b8fc0799-438e-4be2-8ec1-2f721dc79016" released by "_delete_snapshot" :: held 1.738s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:09 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Lock "cinder-quobyte-c0e2edc8-a240-4c46-aede-faf13ce38b51" released by "delete_snapshot" :: held 1.764s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:10 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Created reservations ['949ab1c5-9424-4628-b9d2-910e336b6e14', '3449af0d-f2c6-431e-8f95-3006d616742a', '3899c33a-b04b-4ab2-9a33-18925de8bee3', '986b81db-2f9c-47f7-8457-a438ed7bc217'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:46:10 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Delete snapshot completed successfully. Sep 18 11:46:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a7ac9543-8cca-47fc-8b6d-7d7c25ecdf1a tempest-VolumesExtendTest-2091688887 None] Lock "cinder-b8fc0799-438e-4be2-8ec1-2f721dc79016-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "cinder-c0e2edc8-a240-4c46-aede-faf13ce38b51-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Lock "cinder-c0e2edc8-a240-4c46-aede-faf13ce38b51-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:11 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "cinder-quobyte-c0e2edc8-a240-4c46-aede-faf13ce38b51" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Lock "cinder-quobyte-c0e2edc8-a240-4c46-aede-faf13ce38b51" acquired by "delete_volume" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:11 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[993cafaa-2fca-40f4-96bd-74b31e0ff8a9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:46:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51" returned: 0 in 0.494s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0e2edc8-a240-4c46-aede-faf13ce38b51" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Lock "cinder-quobyte-c0e2edc8-a240-4c46-aede-faf13ce38b51" released by "delete_volume" :: held 0.751s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Created reservations ['b2a94e66-2216-4b9b-bdd9-eca71edb6c3e', '1c57b66f-e5f4-4ee9-8f32-c37f96619d67', 'ca200d15-f1d5-41c0-8848-ea21ca64c978', '7c43c961-85fe-4cf6-bfbd-4e049665ca41'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.095s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:12 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:46:12 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Deleted volume successfully. Sep 18 11:46:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ba99cdda-1129-4f18-aa96-d7453a5acb76 tempest-VolumesExtendTest-2091688887 None] Lock "cinder-c0e2edc8-a240-4c46-aede-faf13ce38b51-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:19 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Flow 'volume_create_manager' (7b2899e0-0453-4730-a9b9-2092538ebf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f43c64-444e-4e6c-9e59-8541584c6798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f43c64-444e-4e6c-9e59-8541584c6798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-734724507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e48c7e-3b70-437b-81ef-fb77a95dc5f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7e73417148a42248900d8b4ebaf6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:20Z,use_quota=True,user_id='5a06a500c6f3406a81705915ae529166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78246bf-2638-463d-8967-88d175c9d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78246bf-2638-463d-8967-88d175c9d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777b0d98-d128-481c-a0d3-cd0af5e92e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777b0d98-d128-481c-a0d3-cd0af5e92e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e48c7e-3b70-437b-81ef-fb77a95dc5f8', 'volume_name': 'volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919f5b0f-c2a3-468b-93da-dd385e7cce60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919f5b0f-c2a3-468b-93da-dd385e7cce60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ccc07f-7c2f-401a-ac25-17a9246d00be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:20 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Volume 69e48c7e-3b70-437b-81ef-fb77a95dc5f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8', 'volume_size': 1} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-734724507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e48c7e-3b70-437b-81ef-fb77a95dc5f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7e73417148a42248900d8b4ebaf6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:20Z,use_quota=True,user_id='5a06a500c6f3406a81705915ae529166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Creating volume 69e48c7e-3b70-437b-81ef-fb77a95dc5f8 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:46:20 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:20 devstack quobyte-client[83210]: System call of process 92931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:46:20 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=83, name=volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8 1073741824" returned: 0 in 0.457s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8" returned: 0 in 0.132s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] <== create_volume: return (671ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:46:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ccc07f-7c2f-401a-ac25-17a9246d00be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c88067-dc25-4397-9d90-052330548df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:21 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Volume volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8 (69e48c7e-3b70-437b-81ef-fb77a95dc5f8): created successfully Sep 18 11:46:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c88067-dc25-4397-9d90-052330548df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Flow 'volume_create_manager' (7b2899e0-0453-4730-a9b9-2092538ebf62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:21 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-c9829ba6-2e69-4a64-b4d2-8c7850ccdfe7 tempest-VolumesListTestJSON-1956998974 None] Created volume successfully. Sep 18 11:46:22 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Flow 'volume_create_manager' (10982c14-3f06-4aa1-bcf5-28b6c994063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14743971-5809-482d-bc1f-6f38c0909fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14743971-5809-482d-bc1f-6f38c0909fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-814299235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2790f80-6fe0-4822-89b9-d8cdfc52c187,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7e73417148a42248900d8b4ebaf6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:22Z,use_quota=True,user_id='5a06a500c6f3406a81705915ae529166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929f0e38-583e-4401-907b-b850247e3def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929f0e38-583e-4401-907b-b850247e3def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f044d3-5b8c-4a66-b83d-6ddd0b2e1dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f044d3-5b8c-4a66-b83d-6ddd0b2e1dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2790f80-6fe0-4822-89b9-d8cdfc52c187', 'volume_name': 'volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c46bb7-a12c-433b-bc29-40eb95db1266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c46bb7-a12c-433b-bc29-40eb95db1266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d798b4e-6fc7-48c7-bc47-75d88e4ed85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:22 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Volume c2790f80-6fe0-4822-89b9-d8cdfc52c187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187', 'volume_size': 1} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-814299235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2790f80-6fe0-4822-89b9-d8cdfc52c187,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7e73417148a42248900d8b4ebaf6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:22Z,use_quota=True,user_id='5a06a500c6f3406a81705915ae529166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Creating volume c2790f80-6fe0-4822-89b9-d8cdfc52c187 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:46:22 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:46:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:22 devstack quobyte-client[83210]: System call of process 92935 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:46:22 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=84, name=volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187 1073741824" returned: 0 in 0.390s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187" returned: 0 in 0.093s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d798b4e-6fc7-48c7-bc47-75d88e4ed85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2a2538-20c9-43ad-96f3-c910fd80134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:23 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Volume volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187 (c2790f80-6fe0-4822-89b9-d8cdfc52c187): created successfully Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2a2538-20c9-43ad-96f3-c910fd80134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Flow 'volume_create_manager' (10982c14-3f06-4aa1-bcf5-28b6c994063d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ea2aa701-1f5e-4c18-bc46-dd96f28ed05b tempest-VolumesListTestJSON-1956998974 None] Created volume successfully. Sep 18 11:46:25 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Flow 'volume_create_manager' (efaf789f-89c8-4e6b-9230-a289c1632d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee5ab40-687e-4cc1-8dd2-6453df2ab208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee5ab40-687e-4cc1-8dd2-6453df2ab208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1164675370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cd93de-58c2-4fe4-9a2c-48cac7863e21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7e73417148a42248900d8b4ebaf6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:25Z,use_quota=True,user_id='5a06a500c6f3406a81705915ae529166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed2d510-c269-4a1a-b3df-1c1ff303617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed2d510-c269-4a1a-b3df-1c1ff303617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13f830e-5e8b-4a10-81b8-ef1e25b536bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13f830e-5e8b-4a10-81b8-ef1e25b536bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cd93de-58c2-4fe4-9a2c-48cac7863e21', 'volume_name': 'volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9654f34-3988-4a75-bacc-3d1e2a67fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9654f34-3988-4a75-bacc-3d1e2a67fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd36da1-4df0-44a7-a55f-cfcf5f34209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:25 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Volume d4cd93de-58c2-4fe4-9a2c-48cac7863e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21', 'volume_size': 1} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1164675370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cd93de-58c2-4fe4-9a2c-48cac7863e21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7e73417148a42248900d8b4ebaf6933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:25Z,use_quota=True,user_id='5a06a500c6f3406a81705915ae529166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Creating volume d4cd93de-58c2-4fe4-9a2c-48cac7863e21 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:46:25 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:25 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=85, name=volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21 1073741824" returned: 0 in 0.371s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21" returned: 0 in 0.133s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] <== create_volume: return (566ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:46:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.576s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd36da1-4df0-44a7-a55f-cfcf5f34209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0794afd-9025-4423-bc02-bf288890ef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:26 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Volume volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21 (d4cd93de-58c2-4fe4-9a2c-48cac7863e21): created successfully Sep 18 11:46:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0794afd-9025-4423-bc02-bf288890ef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Flow 'volume_create_manager' (efaf789f-89c8-4e6b-9230-a289c1632d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:26 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-81f16142-6e5d-4e6d-8e5a-3851d1eac4f0 tempest-VolumesListTestJSON-1956998974 None] Created volume successfully. Sep 18 11:46:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "cinder-d4cd93de-58c2-4fe4-9a2c-48cac7863e21-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-d4cd93de-58c2-4fe4-9a2c-48cac7863e21-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:30 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=53,cinder:SELECT=35,cinder:INSERT=9,cinder:DELETE=4 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:46:30 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=42,cinder:UPDATE=47,cinder:DELETE=6,cinder:INSERT=20 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:46:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "cinder-quobyte-d4cd93de-58c2-4fe4-9a2c-48cac7863e21" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-quobyte-d4cd93de-58c2-4fe4-9a2c-48cac7863e21" acquired by "delete_volume" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:30 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9a37ee-3d64-4ea0-ac69-e76d04d7b152]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:46:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21" returned: 0 in 0.425s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d4cd93de-58c2-4fe4-9a2c-48cac7863e21" returned: 0 in 0.092s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-quobyte-d4cd93de-58c2-4fe4-9a2c-48cac7863e21" released by "delete_volume" :: held 0.678s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Created reservations ['97dba714-42b9-4780-b169-d24dfbb2c95d', 'e5215ce0-c135-4009-a41d-af698e7a66ee', '0f309a97-6696-4e89-be74-e42f12860a54', '4e03f89e-7ac8-46be-a612-63eff5bbd10b'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.082s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:31 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:46:31 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Deleted volume successfully. Sep 18 11:46:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7d62129c-8130-45cf-9a9c-8eef5008ab72 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-d4cd93de-58c2-4fe4-9a2c-48cac7863e21-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "cinder-c2790f80-6fe0-4822-89b9-d8cdfc52c187-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-c2790f80-6fe0-4822-89b9-d8cdfc52c187-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:32 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "cinder-quobyte-c2790f80-6fe0-4822-89b9-d8cdfc52c187" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-quobyte-c2790f80-6fe0-4822-89b9-d8cdfc52c187" acquired by "delete_volume" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:32 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d327da-c30d-48d6-a7db-94e16ce09f61]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:46:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187" returned: 0 in 0.452s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c2790f80-6fe0-4822-89b9-d8cdfc52c187" returned: 0 in 0.095s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-quobyte-c2790f80-6fe0-4822-89b9-d8cdfc52c187" released by "delete_volume" :: held 0.702s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:33 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Created reservations ['ff376b04-29e3-4a43-b28d-3c8a391dfb10', '7da7822d-503f-42bd-a7e1-0c8403be586f', '40d40a54-95d1-496b-b415-72aebf48c7d6', 'e4f1ea17-4053-479d-98ef-e023fd9e49a8'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.092s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:46:34 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Deleted volume successfully. Sep 18 11:46:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-dca4e3a0-9f8c-43ce-b050-77cc1c2278c0 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-c2790f80-6fe0-4822-89b9-d8cdfc52c187-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "cinder-69e48c7e-3b70-437b-81ef-fb77a95dc5f8-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-69e48c7e-3b70-437b-81ef-fb77a95dc5f8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:35 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "cinder-quobyte-69e48c7e-3b70-437b-81ef-fb77a95dc5f8" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:46:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-quobyte-69e48c7e-3b70-437b-81ef-fb77a95dc5f8" acquired by "delete_volume" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:46:35 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e358d7db-6445-4ec4-a004-6bac7bcd0fe3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:46:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8" returned: 0 in 0.531s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69e48c7e-3b70-437b-81ef-fb77a95dc5f8" returned: 0 in 0.116s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-quobyte-69e48c7e-3b70-437b-81ef-fb77a95dc5f8" released by "delete_volume" :: held 0.800s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Created reservations ['7de74b41-317a-499d-a50e-32d564a6180c', '08e14b82-56a8-46fc-bd3d-90d54a20012b', '97c34c8b-9d86-4856-bce9-7051c614f0ea', '720f1ff0-4c4e-4c6c-a43d-0ab43bc64a07'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.101s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:36 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:46:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Deleted volume successfully. Sep 18 11:46:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-de4f022c-c9a7-4f45-835a-c88798a1fde5 tempest-VolumesListTestJSON-1956998974 None] Lock "cinder-69e48c7e-3b70-437b-81ef-fb77a95dc5f8-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.205s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:46:46 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=17,cinder:UPDATE=33,cinder:INSERT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:46:46 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=12,cinder:INSERT=10,cinder:UPDATE=14,cinder:DELETE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:46:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Flow 'volume_create_manager' (db041680-369d-46c3-a70c-a31a1ea70683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d412d10-314c-4592-9b32-7e08c45c9670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d412d10-314c-4592-9b32-7e08c45c9670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1698861313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159650fa986f4e399ff9f87ceeaf5dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:57Z,use_quota=True,user_id='4824eeb399f64d23bb4ce689dcdf909a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b52e8b-ccf1-4f4a-906c-89454b4d9b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b52e8b-ccf1-4f4a-906c-89454b4d9b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ca8b0d-8d41-4066-b775-2284b5b11d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ca8b0d-8d41-4066-b775-2284b5b11d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad', 'volume_name': 'volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b008deb9-b575-4300-bf2c-4f755dc65464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b008deb9-b575-4300-bf2c-4f755dc65464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b266474-3241-4b52-9b78-d4895466a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:57 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Volume 4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad', 'volume_size': 1} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1698861313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159650fa986f4e399ff9f87ceeaf5dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:46:57Z,use_quota=True,user_id='4824eeb399f64d23bb4ce689dcdf909a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Creating volume 4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:46:57 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:57 devstack quobyte-client[83210]: System call of process 93017 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:46:57 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=86, name=volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad 1073741824" returned: 0 in 0.581s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:46:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad" returned: 0 in 0.191s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:46:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] <== create_volume: return (886ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:46:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:46:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b266474-3241-4b52-9b78-d4895466a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9f78ac-9a76-4911-849d-09b72eb72362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:46:58 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Volume volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad (4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad): created successfully Sep 18 11:46:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9f78ac-9a76-4911-849d-09b72eb72362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:46:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Flow 'volume_create_manager' (db041680-369d-46c3-a70c-a31a1ea70683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:46:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7d9f9f97-3300-4c49-a3fe-3e413b1e4e48 tempest-AttachVolumeNegativeTest-1100748550 None] Created volume successfully. Sep 18 11:47:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-5cd759bc-f479-4708-a626-57b849839841 req-3e0a7f94-d8dd-4ea2-85d4-66110a644ae0 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-5cd759bc-f479-4708-a626-57b849839841 req-3e0a7f94-d8dd-4ea2-85d4-66110a644ae0 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:04 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4986c-c409-4866-9930-81c806cbd6b7]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:47:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-5cd759bc-f479-4708-a626-57b849839841 req-3e0a7f94-d8dd-4ea2-85d4-66110a644ae0 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-5cd759bc-f479-4708-a626-57b849839841 req-3e0a7f94-d8dd-4ea2-85d4-66110a644ae0 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad" returned: 0 in 0.499s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-5cd759bc-f479-4708-a626-57b849839841 req-3e0a7f94-d8dd-4ea2-85d4-66110a644ae0 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.568s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-5cd759bc-f479-4708-a626-57b849839841 req-3e0a7f94-d8dd-4ea2-85d4-66110a644ae0 tempest-AttachVolumeNegativeTest-1100748550 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b32fee80-4c12-4dac-890d-4784a3602ee5', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:47:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-5cd759bc-f479-4708-a626-57b849839841 req-3e0a7f94-d8dd-4ea2-85d4-66110a644ae0 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:47:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-5cd759bc-f479-4708-a626-57b849839841 req-3e0a7f94-d8dd-4ea2-85d4-66110a644ae0 tempest-AttachVolumeNegativeTest-1100748550 None] attachment_update completed successfully. Sep 18 11:47:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Flow 'volume_create_manager' (e47e8788-2804-4192-9b8a-a229d47953b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2721c143-32c8-46c8-a432-71d2e81ca75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2721c143-32c8-46c8-a432-71d2e81ca75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1152964642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926d2761-44cc-406e-b859-a17816d1f0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3751042ac4316ae184248bceee414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:08Z,use_quota=True,user_id='a3e627f9ec094edd84e18ec2c8ed8abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4f2ab13-ddbc-4997-bce8-b3a9be1b3482),volume_type_id=e4f2ab13-ddbc-4997-bce8-b3a9be1b3482)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ec55fe-ab8f-4d4b-9a65-5784116f88b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ec55fe-ab8f-4d4b-9a65-5784116f88b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff4df01-e68b-496f-a317-b63f0bba4b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff4df01-e68b-496f-a317-b63f0bba4b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926d2761-44cc-406e-b859-a17816d1f0cf', 'volume_name': 'volume-926d2761-44cc-406e-b859-a17816d1f0cf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d64f24a-18a3-43c7-b810-19abc3a3d6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d64f24a-18a3-43c7-b810-19abc3a3d6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d0396d-0bb8-4c0c-9af5-3adda4d009dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:07 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Volume 926d2761-44cc-406e-b859-a17816d1f0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926d2761-44cc-406e-b859-a17816d1f0cf', 'volume_size': 1} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1152964642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926d2761-44cc-406e-b859-a17816d1f0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3751042ac4316ae184248bceee414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:08Z,use_quota=True,user_id='a3e627f9ec094edd84e18ec2c8ed8abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4f2ab13-ddbc-4997-bce8-b3a9be1b3482),volume_type_id=e4f2ab13-ddbc-4997-bce8-b3a9be1b3482)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Creating volume 926d2761-44cc-406e-b859-a17816d1f0cf {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:47:07 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:47:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:08 devstack quobyte-client[83210]: System call of process 93430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:47:08 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=87, name=volume-926d2761-44cc-406e-b859-a17816d1f0cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:47:08 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Flow 'volume_create_manager' (a1bcf972-0ca8-44ad-b429-b72a9f8f229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a2a8ba-ffb7-48c3-906d-ea3140c45bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a2a8ba-ffb7-48c3-906d-ea3140c45bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1581240270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf492fc-3ea2-4aa7-a7d7-8720e610d111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3751042ac4316ae184248bceee414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:08Z,use_quota=True,user_id='a3e627f9ec094edd84e18ec2c8ed8abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c0f4e8f-1462-49b9-827a-7c0518d1412f),volume_type_id=2c0f4e8f-1462-49b9-827a-7c0518d1412f)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5280b9-53f5-4dc9-8ad2-6b7c35858db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5280b9-53f5-4dc9-8ad2-6b7c35858db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3364f476-914f-498c-95bc-1028f9a1ce0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3364f476-914f-498c-95bc-1028f9a1ce0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf492fc-3ea2-4aa7-a7d7-8720e610d111', 'volume_name': 'volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afeb8a96-517d-4be1-b3fd-82ad6bb021ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afeb8a96-517d-4be1-b3fd-82ad6bb021ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3706db4-5c6a-491f-94be-52f6160e57ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:08 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume faf492fc-3ea2-4aa7-a7d7-8720e610d111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111', 'volume_size': 1} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf 1073741824" returned: 0 in 0.947s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf" returned: 0 in 0.395s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] <== create_volume: return (1369ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1581240270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf492fc-3ea2-4aa7-a7d7-8720e610d111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3751042ac4316ae184248bceee414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:08Z,use_quota=True,user_id='a3e627f9ec094edd84e18ec2c8ed8abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c0f4e8f-1462-49b9-827a-7c0518d1412f),volume_type_id=2c0f4e8f-1462-49b9-827a-7c0518d1412f)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Creating volume faf492fc-3ea2-4aa7-a7d7-8720e610d111 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:47:09 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:09 devstack quobyte-client[83210]: System call of process 93436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:47:09 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=88, name=volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:47:09 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Flow 'volume_create_manager' (011d916f-90e6-4ef6-909d-1edada1ce9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f975c3f3-cee6-4803-9c59-a47fb9e31039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d0396d-0bb8-4c0c-9af5-3adda4d009dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926d2761-44cc-406e-b859-a17816d1f0cf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d60bb97-2c3b-4be8-ac06-f7288782b58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111 1073741824" returned: 0 in 0.619s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f975c3f3-cee6-4803-9c59-a47fb9e31039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1073361243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb946320-e88c-42ac-ab8f-26cd311bd1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3751042ac4316ae184248bceee414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:09Z,use_quota=True,user_id='a3e627f9ec094edd84e18ec2c8ed8abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31e4863b-9734-48f6-ab01-c22ade079e6e),volume_type_id=31e4863b-9734-48f6-ab01-c22ade079e6e)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defff2d3-8a23-4d89-a851-4a751fe4fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defff2d3-8a23-4d89-a851-4a751fe4fbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d69530-17c6-4c41-9a26-429aaf419d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:09 devstack cinder-volume[83184]: DEBUG cinder.image.glance [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Creating Keystone auth plugin from conf {{(pid=83184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:10 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Volume volume-926d2761-44cc-406e-b859-a17816d1f0cf (926d2761-44cc-406e-b859-a17816d1f0cf): created successfully Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d60bb97-2c3b-4be8-ac06-f7288782b58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Flow 'volume_create_manager' (e47e8788-2804-4192-9b8a-a229d47953b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111" returned: 0 in 0.531s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] <== create_volume: return (1302ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:10 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-337942c5-390b-408a-9b25-694c66164e4d tempest-TestInstancesWithCinderVolumes-563462860 None] Created volume successfully. Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3706db4-5c6a-491f-94be-52f6160e57ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89ecd58-1c59-4456-9a28-13dac49cbdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:10 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111 (faf492fc-3ea2-4aa7-a7d7-8720e610d111): created successfully Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89ecd58-1c59-4456-9a28-13dac49cbdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Flow 'volume_create_manager' (a1bcf972-0ca8-44ad-b429-b72a9f8f229b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:47:10 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5e961f22-ddfd-4f37-81e8-c47eefa371b2 tempest-TestInstancesWithCinderVolumes-563462860 None] Created volume successfully. Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d69530-17c6-4c41-9a26-429aaf419d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb946320-e88c-42ac-ab8f-26cd311bd1f3', 'volume_name': 'volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3', 'volume_size': 1, 'image_id': '4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2102525031', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '93c3751042ac4316ae184248bceee414', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'created_at': datetime.datetime(2025, 9, 18, 9, 47, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 47, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415/file', 'properties': {}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4032436d-3cce-4a66-b551-3dab69586a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4032436d-3cce-4a66-b551-3dab69586a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912a9675-1bb3-48b7-8e9f-89c73e107a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:10 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume cb946320-e88c-42ac-ab8f-26cd311bd1f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3', 'volume_size': 1, 'image_id': '4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2102525031', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '93c3751042ac4316ae184248bceee414', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'created_at': datetime.datetime(2025, 9, 18, 9, 47, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 47, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415/file', 'properties': {}}, 'image_service': } Sep 18 11:47:10 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Cloning cb946320-e88c-42ac-ab8f-26cd311bd1f3 from image 4a830b3c-278d-4d9d-a3e7-e371e2b19415 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'metadata': {}}]). {{(pid=83184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 18 11:47:12 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD, size 20.69 MB, duration 1.58 sec {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 18 11:47:12 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Image download 20.69 MB at 13.10 MB/s Sep 18 11:47:12 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48064057-80b4-4b94-b9f0-920778dda979]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:47:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:12 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD Sep 18 11:47:12 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:47:14 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Sep 18 11:47:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD" returned: 0 in 2.163s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:14 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Temporary image 4a830b3c-278d-4d9d-a3e7-e371e2b19415 is fetched for user a3e627f9ec094edd84e18ec2c8ed8abf. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 18 11:47:14 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac84370-860a-454e-9a22-4acb199180e1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:47:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:15 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD Sep 18 11:47:15 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:47:17 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD" returned: 0 in 2.204s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1073361243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb946320-e88c-42ac-ab8f-26cd311bd1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3751042ac4316ae184248bceee414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:47:09Z,use_quota=True,user_id='a3e627f9ec094edd84e18ec2c8ed8abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31e4863b-9734-48f6-ab01-c22ade079e6e),volume_type_id=31e4863b-9734-48f6-ab01-c22ade079e6e)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Creating volume cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:47:17 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:17 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=89, name=volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 1073741824" returned: 0 in 0.337s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 0 in 0.116s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] <== create_volume: return (570ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:47:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.605s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:18 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Attempting download of 4a830b3c-278d-4d9d-a3e7-e371e2b19415 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'metadata': {}}])) to volume cb946320-e88c-42ac-ab8f-26cd311bd1f3. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 18 11:47:18 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c331139-6d8f-46e8-ad57-7cade707697f]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:47:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a830b3c-278d-4d9d-a3e7-e371e2b19415_org1c4yx {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a830b3c-278d-4d9d-a3e7-e371e2b19415_org1c4yx" returned: 0 in 0.338s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a830b3c-278d-4d9d-a3e7-e371e2b19415_org1c4yx {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a830b3c-278d-4d9d-a3e7-e371e2b19415_org1c4yx" returned: 1 in 0.400s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a830b3c-278d-4d9d-a3e7-e371e2b19415_org1c4yx' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:47:19 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[08071704-0c06-4349-a0be-0f9a2abbfbb0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:47:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:19 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] 4a830b3c-278d-4d9d-a3e7-e371e2b19415 was qcow2, converting to raw {{(pid=83184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 18 11:47:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:19 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=89, name=volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:47:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 0 in 0.912s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:20 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a830b3c-278d-4d9d-a3e7-e371e2b19415_61fktigxdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 11:47:20 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Converted 112.00 MB image at 112.00 MB/s Sep 18 11:47:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 1G" returned: 0 in 0.190s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:20 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5771563c-4a10-48c2-9f94-ee4bd209af49]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:47:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 0 in 0.554s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 1 in 0.651s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Downloaded image 4a830b3c-278d-4d9d-a3e7-e371e2b19415 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'metadata': {}}])) to volume cb946320-e88c-42ac-ab8f-26cd311bd1f3 successfully. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Temporary image 4a830b3c-278d-4d9d-a3e7-e371e2b19415 for user a3e627f9ec094edd84e18ec2c8ed8abf is deleted. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Marking volume cb946320-e88c-42ac-ab8f-26cd311bd1f3 as bootable. {{(pid=83184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Copying metadata from image 4a830b3c-278d-4d9d-a3e7-e371e2b19415 to cb946320-e88c-42ac-ab8f-26cd311bd1f3. {{(pid=83184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Creating volume glance metadata for volume cb946320-e88c-42ac-ab8f-26cd311bd1f3 backed by image 4a830b3c-278d-4d9d-a3e7-e371e2b19415 with: {'image_id': '4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'image_name': 'tempest-scenario-img--2102525031', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912a9675-1bb3-48b7-8e9f-89c73e107a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3', 'volume_size': 1, 'image_id': '4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2102525031', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '93c3751042ac4316ae184248bceee414', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a830b3c-278d-4d9d-a3e7-e371e2b19415', 'created_at': datetime.datetime(2025, 9, 18, 9, 47, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 47, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a830b3c-278d-4d9d-a3e7-e371e2b19415/file', 'properties': {}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bdf5da-d0e7-409f-a942-5b9a32d772e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:47:22 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 (cb946320-e88c-42ac-ab8f-26cd311bd1f3): created successfully Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bdf5da-d0e7-409f-a942-5b9a32d772e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:47:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Flow 'volume_create_manager' (011d916f-90e6-4ef6-909d-1edada1ce9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:47:22 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-fe56ded9-2454-4605-9584-3a39410e9011 tempest-TestInstancesWithCinderVolumes-563462860 None] Created volume successfully. Sep 18 11:47:32 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8,cinder:INSERT=7 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:47:32 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:DELETE=4,cinder:INSERT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:47:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:34 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4718499-609e-4c59-9e9e-2a0f76ebb425]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:47:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:34 devstack quobyte-client[83210]: System call of process 93612 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:47:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 0 in 0.922s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:35 devstack quobyte-client[83210]: System call of process 93620 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:47:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 1 in 0.802s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:47:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.110s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7034bdb-5f22-4006-8b06-37b6969b8dff', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:47:36 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:47:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-7fc9e4e8-f05a-4ca9-b19e-a0e126635787 req-eaffd55f-a96e-496f-86ad-82b751cd907e tempest-TestInstancesWithCinderVolumes-563462860 None] attachment_update completed successfully. Sep 18 11:47:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:47:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:47:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:47:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:47:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:47:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:47:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:47:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.472s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:47:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:47:46 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:47:46 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:47:57 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:47:57 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.130s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:48:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:49:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-1b559a9c-ee9d-4333-a799-6f6936847771 req-aa24e697-5fb9-477e-876e-747748417c7b tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:49:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-1b559a9c-ee9d-4333-a799-6f6936847771 req-aa24e697-5fb9-477e-876e-747748417c7b tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:49:04 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba7d0b-4c58-41b5-a1e6-52e00984aab5]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:49:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-1b559a9c-ee9d-4333-a799-6f6936847771 req-aa24e697-5fb9-477e-876e-747748417c7b tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:49:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-1b559a9c-ee9d-4333-a799-6f6936847771 req-aa24e697-5fb9-477e-876e-747748417c7b tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf" returned: 0 in 0.835s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:49:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-1b559a9c-ee9d-4333-a799-6f6936847771 req-aa24e697-5fb9-477e-876e-747748417c7b tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:49:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-1b559a9c-ee9d-4333-a799-6f6936847771 req-aa24e697-5fb9-477e-876e-747748417c7b tempest-TestInstancesWithCinderVolumes-563462860 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-926d2761-44cc-406e-b859-a17816d1f0cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04ff1e7d-deeb-4871-8c92-bd6b64415e0e', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:49:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-1b559a9c-ee9d-4333-a799-6f6936847771 req-aa24e697-5fb9-477e-876e-747748417c7b tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:49:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-1b559a9c-ee9d-4333-a799-6f6936847771 req-aa24e697-5fb9-477e-876e-747748417c7b tempest-TestInstancesWithCinderVolumes-563462860 None] attachment_update completed successfully. Sep 18 11:49:15 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:49:15 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:49:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b10c5c30-e505-487e-86d0-5976c54e181c req-1c6bb264-3359-4de1-8f2e-996a5852c3a2 tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:49:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b10c5c30-e505-487e-86d0-5976c54e181c req-1c6bb264-3359-4de1-8f2e-996a5852c3a2 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:49:16 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[536940e4-1359-4457-9d58-e02f37ff004f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:49:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b10c5c30-e505-487e-86d0-5976c54e181c req-1c6bb264-3359-4de1-8f2e-996a5852c3a2 tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:49:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-b10c5c30-e505-487e-86d0-5976c54e181c req-1c6bb264-3359-4de1-8f2e-996a5852c3a2 tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111" returned: 0 in 0.420s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:49:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-b10c5c30-e505-487e-86d0-5976c54e181c req-1c6bb264-3359-4de1-8f2e-996a5852c3a2 tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.482s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:49:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b10c5c30-e505-487e-86d0-5976c54e181c req-1c6bb264-3359-4de1-8f2e-996a5852c3a2 tempest-TestInstancesWithCinderVolumes-563462860 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7eaa5d39-b79a-4c2e-b65d-eb51b6be3094', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:49:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b10c5c30-e505-487e-86d0-5976c54e181c req-1c6bb264-3359-4de1-8f2e-996a5852c3a2 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:49:17 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-b10c5c30-e505-487e-86d0-5976c54e181c req-1c6bb264-3359-4de1-8f2e-996a5852c3a2 tempest-TestInstancesWithCinderVolumes-563462860 None] attachment_update completed successfully. Sep 18 11:49:27 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:49:27 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:49:28 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-54880136-97fb-4bfd-af59-a235187f036a req-995ec9c7-69dc-4963-b453-a03fb27eb81a tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:49:28 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-54880136-97fb-4bfd-af59-a235187f036a req-995ec9c7-69dc-4963-b453-a03fb27eb81a tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:49:28 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-54880136-97fb-4bfd-af59-a235187f036a req-995ec9c7-69dc-4963-b453-a03fb27eb81a tempest-AttachVolumeNegativeTest-1100748550 None] Terminate volume connection completed successfully. Sep 18 11:49:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-54880136-97fb-4bfd-af59-a235187f036a req-995ec9c7-69dc-4963-b453-a03fb27eb81a tempest-AttachVolumeNegativeTest-1100748550 None] Deleting attachment b32fee80-4c12-4dac-890d-4784a3602ee5. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:49:38 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.105s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:49:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:49:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-423dc1eb-146d-4c9f-9232-09ab83f9f02b req-0bb81d2e-5c58-4750-957a-40e4538e7cdb tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:49:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-423dc1eb-146d-4c9f-9232-09ab83f9f02b req-0bb81d2e-5c58-4750-957a-40e4538e7cdb tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:49:51 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-423dc1eb-146d-4c9f-9232-09ab83f9f02b req-0bb81d2e-5c58-4750-957a-40e4538e7cdb tempest-TestInstancesWithCinderVolumes-563462860 None] Terminate volume connection completed successfully. Sep 18 11:49:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-423dc1eb-146d-4c9f-9232-09ab83f9f02b req-0bb81d2e-5c58-4750-957a-40e4538e7cdb tempest-TestInstancesWithCinderVolumes-563462860 None] Deleting attachment 04ff1e7d-deeb-4871-8c92-bd6b64415e0e. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:49:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "cinder-926d2761-44cc-406e-b859-a17816d1f0cf-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:49:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-926d2761-44cc-406e-b859-a17816d1f0cf-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:49:53 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:49:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "cinder-quobyte-926d2761-44cc-406e-b859-a17816d1f0cf" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:49:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-quobyte-926d2761-44cc-406e-b859-a17816d1f0cf" acquired by "delete_volume" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:49:54 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0324fb46-3284-4392-83fd-561334ce0f15]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:49:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:49:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf" returned: 0 in 0.778s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:49:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-926d2761-44cc-406e-b859-a17816d1f0cf" returned: 0 in 0.184s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-quobyte-926d2761-44cc-406e-b859-a17816d1f0cf" released by "delete_volume" :: held 1.281s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:49:55 devstack cinder-volume[83184]: WARNING cinder.quota [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1668855435-52259153 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1668855435-52259153, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:49:55 devstack cinder-volume[83184]: WARNING cinder.quota [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1668855435-52259153 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1668855435-52259153, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Created reservations ['e8791c0c-ad13-41dd-8139-77848d8dbd5c', '08f4be28-1c61-49e4-9635-99c2fbc16346', 'cef04db1-21d0-4345-a186-e58044e3bfed', '2448161f-996b-4e95-855f-4eeca8c7915c'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.104s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:49:55 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:49:55 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Deleted volume successfully. Sep 18 11:49:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24373539-ec94-43f6-b2b1-c7bdeb0121cc tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-926d2761-44cc-406e-b859-a17816d1f0cf-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:50:05 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:50:06 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:50:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-1619bfbf-b469-4c98-afd0-53b06751e623 req-c8b3ec52-bee8-4b55-bdd7-5aa04aaaf81d tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:50:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-1619bfbf-b469-4c98-afd0-53b06751e623 req-c8b3ec52-bee8-4b55-bdd7-5aa04aaaf81d tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:50:27 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-1619bfbf-b469-4c98-afd0-53b06751e623 req-c8b3ec52-bee8-4b55-bdd7-5aa04aaaf81d tempest-TestInstancesWithCinderVolumes-563462860 None] Terminate volume connection completed successfully. Sep 18 11:50:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-1619bfbf-b469-4c98-afd0-53b06751e623 req-c8b3ec52-bee8-4b55-bdd7-5aa04aaaf81d tempest-TestInstancesWithCinderVolumes-563462860 None] Deleting attachment 7eaa5d39-b79a-4c2e-b65d-eb51b6be3094. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:50:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "cinder-faf492fc-3ea2-4aa7-a7d7-8720e610d111-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:50:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-faf492fc-3ea2-4aa7-a7d7-8720e610d111-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:50:29 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:50:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "cinder-quobyte-faf492fc-3ea2-4aa7-a7d7-8720e610d111" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:50:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-quobyte-faf492fc-3ea2-4aa7-a7d7-8720e610d111" acquired by "delete_volume" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:50:29 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[611c252e-8c9a-4d75-a46e-307fbe0ebbf6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:50:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:50:30 devstack quobyte-client[83210]: System call of process 94283 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111" returned: 0 in 0.642s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-faf492fc-3ea2-4aa7-a7d7-8720e610d111" returned: 0 in 0.150s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-quobyte-faf492fc-3ea2-4aa7-a7d7-8720e610d111" released by "delete_volume" :: held 1.016s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:50:30 devstack cinder-volume[83184]: WARNING cinder.quota [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2088792265-984057168 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2088792265-984057168, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:50:30 devstack cinder-volume[83184]: WARNING cinder.quota [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2088792265-984057168 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2088792265-984057168, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Created reservations ['12ba9d14-8b21-4c0c-bca2-59a3cabb70ea', 'b732b8d7-437e-4b8b-91f5-5db9975559ae', 'c0e9ece3-3f7b-4312-9e41-115d9df62362', '2b722c37-70b8-4dfe-b763-1f13d0e697c5'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:50:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:50:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.164s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:50:31 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:50:31 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Deleted volume successfully. Sep 18 11:50:31 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3437c177-282b-4f06-954b-1b7ee9da804e tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-faf492fc-3ea2-4aa7-a7d7-8720e610d111-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:50:40 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-2f652b77-ae95-4d06-9a77-179c93bedfd4 req-d52cd029-4c99-4ab2-9f54-c96f6e7babd5 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:50:40 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-2f652b77-ae95-4d06-9a77-179c93bedfd4 req-d52cd029-4c99-4ab2-9f54-c96f6e7babd5 tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:50:40 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-2f652b77-ae95-4d06-9a77-179c93bedfd4 req-d52cd029-4c99-4ab2-9f54-c96f6e7babd5 tempest-TestInstancesWithCinderVolumes-563462860 None] Terminate volume connection completed successfully. Sep 18 11:50:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-2f652b77-ae95-4d06-9a77-179c93bedfd4 req-d52cd029-4c99-4ab2-9f54-c96f6e7babd5 tempest-TestInstancesWithCinderVolumes-563462860 None] Deleting attachment a7034bdb-5f22-4006-8b06-37b6969b8dff. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "cinder-cb946320-e88c-42ac-ab8f-26cd311bd1f3-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.164s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-cb946320-e88c-42ac-ab8f-26cd311bd1f3-delete_volume" acquired by "delete_volume" :: waited 0.260s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:50:44 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "cinder-quobyte-cb946320-e88c-42ac-ab8f-26cd311bd1f3" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-quobyte-cb946320-e88c-42ac-ab8f-26cd311bd1f3" acquired by "delete_volume" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8df4ab-a003-4e97-9cd2-b64045a00382]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:50:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:50:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 0 in 0.385s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:50:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:50:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 1 in 0.383s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:50:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:50:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:50:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb946320-e88c-42ac-ab8f-26cd311bd1f3" returned: 0 in 0.078s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:50:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-quobyte-cb946320-e88c-42ac-ab8f-26cd311bd1f3" released by "delete_volume" :: held 1.081s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:50:46 devstack cinder-volume[83184]: WARNING cinder.quota [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-866983781-2026290704 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-866983781-2026290704, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:50:46 devstack cinder-volume[83184]: WARNING cinder.quota [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-866983781-2026290704 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-866983781-2026290704, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Created reservations ['b2013d82-45a0-4ffe-8245-0900ff046e77', 'ef600354-6648-4b11-9f36-9259190ef51e', '3c602584-9c34-4c5f-9be5-d07a2df47f43', '2982ef00-a7a8-453d-9b34-f4440ab6ba44'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.082s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:50:46 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Deleted volume successfully. Sep 18 11:50:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-14b26a15-65e6-48db-85f9-b7a0d11a00ce tempest-TestInstancesWithCinderVolumes-563462860 None] Lock "cinder-cb946320-e88c-42ac-ab8f-26cd311bd1f3-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:50:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=12,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:50:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:51:15 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:51:15 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:51:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Flow 'volume_create_manager' (85703290-e2e4-45ea-868d-947f6b859b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:51:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cfc31f-9a33-4f38-8b62-1f4ae1d5cb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cfc31f-9a33-4f38-8b62-1f4ae1d5cb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-760050754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159650fa986f4e399ff9f87ceeaf5dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:51:16Z,use_quota=True,user_id='4824eeb399f64d23bb4ce689dcdf909a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d66c20-f3da-4717-a9d8-31263c5283f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d66c20-f3da-4717-a9d8-31263c5283f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae570678-9c0d-4cea-add4-40a25199b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae570678-9c0d-4cea-add4-40a25199b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13', 'volume_name': 'volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85927cf9-ce53-429b-ace5-f06158d690c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85927cf9-ce53-429b-ace5-f06158d690c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f3147a-14d3-425a-aa73-3b39ad90080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:51:16 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Volume baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13', 'volume_size': 1} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-760050754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159650fa986f4e399ff9f87ceeaf5dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:51:16Z,use_quota=True,user_id='4824eeb399f64d23bb4ce689dcdf909a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Creating volume baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:51:16 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:51:16 devstack quobyte-client[83210]: System call of process 94436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:51:16 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=90, name=volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13 1073741824" returned: 0 in 0.442s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13" returned: 0 in 0.138s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] <== create_volume: return (658ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:51:16 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f3147a-14d3-425a-aa73-3b39ad90080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:51:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b0e44d-949f-41b6-9193-18b2acb76c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:51:17 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Volume volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13 (baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13): created successfully Sep 18 11:51:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b0e44d-949f-41b6-9193-18b2acb76c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:51:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Flow 'volume_create_manager' (85703290-e2e4-45ea-868d-947f6b859b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:51:17 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-1f47fb96-03d3-45be-9372-f591c8f35d4b tempest-AttachVolumeNegativeTest-1100748550 None] Created volume successfully. Sep 18 11:51:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-2b44b57b-ad57-4733-8f60-aae9c318078b req-1a624a90-e040-4698-ab59-5afffb2653c9 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:51:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-2b44b57b-ad57-4733-8f60-aae9c318078b req-1a624a90-e040-4698-ab59-5afffb2653c9 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:51:22 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fd33c3-f38b-4b83-98ce-af7a848491c0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:51:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-2b44b57b-ad57-4733-8f60-aae9c318078b req-1a624a90-e040-4698-ab59-5afffb2653c9 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:51:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-2b44b57b-ad57-4733-8f60-aae9c318078b req-1a624a90-e040-4698-ab59-5afffb2653c9 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13" returned: 0 in 0.471s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:51:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-2b44b57b-ad57-4733-8f60-aae9c318078b req-1a624a90-e040-4698-ab59-5afffb2653c9 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.531s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:51:23 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-2b44b57b-ad57-4733-8f60-aae9c318078b req-1a624a90-e040-4698-ab59-5afffb2653c9 tempest-AttachVolumeNegativeTest-1100748550 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab391df7-5fb0-4012-b7b9-3fbfe3f22dc8', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:51:23 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-2b44b57b-ad57-4733-8f60-aae9c318078b req-1a624a90-e040-4698-ab59-5afffb2653c9 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:51:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-2b44b57b-ad57-4733-8f60-aae9c318078b req-1a624a90-e040-4698-ab59-5afffb2653c9 tempest-AttachVolumeNegativeTest-1100748550 None] attachment_update completed successfully. Sep 18 11:51:33 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:51:33 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.105s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:51:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:51:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b9e0ebee-377b-46cb-b57d-58e01db9dc70 req-06421350-0184-49c1-8b6e-f88341e443d5 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:51:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-b9e0ebee-377b-46cb-b57d-58e01db9dc70 req-06421350-0184-49c1-8b6e-f88341e443d5 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:51:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-b9e0ebee-377b-46cb-b57d-58e01db9dc70 req-06421350-0184-49c1-8b6e-f88341e443d5 tempest-AttachVolumeNegativeTest-1100748550 None] Terminate volume connection completed successfully. Sep 18 11:51:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-b9e0ebee-377b-46cb-b57d-58e01db9dc70 req-06421350-0184-49c1-8b6e-f88341e443d5 tempest-AttachVolumeNegativeTest-1100748550 None] Deleting attachment ab391df7-5fb0-4012-b7b9-3fbfe3f22dc8. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:51:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:52:02 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.206s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:52:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:53:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:53:07 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:53:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Flow 'volume_create_manager' (9b1cf10d-6d8a-4ce0-860b-c8f4dab9fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:53:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44561e49-044c-4302-b417-43502c499879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44561e49-044c-4302-b417-43502c499879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-544464618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0cf2ef-cb0e-4728-990c-c599a486e62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05e00458c4344feb192055e745a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:07Z,use_quota=True,user_id='7c6e4362ad3c4cb8a2613f90432348d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7ff4c6-3b9b-4cc6-9902-6002d7607e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7ff4c6-3b9b-4cc6-9902-6002d7607e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1108cc3-5609-4bc8-854f-2101456b6488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1108cc3-5609-4bc8-854f-2101456b6488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0cf2ef-cb0e-4728-990c-c599a486e62a', 'volume_name': 'volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29452879-c023-4a0a-aeb2-9c1483e77561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29452879-c023-4a0a-aeb2-9c1483e77561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b60c77-b20c-43a2-a955-65ab0efad239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:08 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Volume ce0cf2ef-cb0e-4728-990c-c599a486e62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a', 'volume_size': 1} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-544464618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0cf2ef-cb0e-4728-990c-c599a486e62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05e00458c4344feb192055e745a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:07Z,use_quota=True,user_id='7c6e4362ad3c4cb8a2613f90432348d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Creating volume ce0cf2ef-cb0e-4728-990c-c599a486e62a {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:53:08 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:08 devstack quobyte-client[83210]: System call of process 95308 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:53:08 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=91, name=volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a 1073741824" returned: 0 in 0.600s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a" returned: 0 in 0.135s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] <== create_volume: return (854ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:53:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:53:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b60c77-b20c-43a2-a955-65ab0efad239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b275643-deeb-4a92-b2cb-f7c594a9b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:09 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Volume volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a (ce0cf2ef-cb0e-4728-990c-c599a486e62a): created successfully Sep 18 11:53:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b275643-deeb-4a92-b2cb-f7c594a9b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Flow 'volume_create_manager' (9b1cf10d-6d8a-4ce0-860b-c8f4dab9fd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:53:09 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ffb2eeb0-044a-458f-8a80-26c5543d3ddf tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Created volume successfully. Sep 18 11:53:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-d003aa8f-2102-4b6c-a6f1-11efc02d28bc req-9f306bf7-c3f7-4d71-9969-37e9951d55d4 tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:53:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-d003aa8f-2102-4b6c-a6f1-11efc02d28bc req-9f306bf7-c3f7-4d71-9969-37e9951d55d4 tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:53:13 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7be2a2-2dc2-4a3c-b689-f101eaf6d246]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:53:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-d003aa8f-2102-4b6c-a6f1-11efc02d28bc req-9f306bf7-c3f7-4d71-9969-37e9951d55d4 tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-d003aa8f-2102-4b6c-a6f1-11efc02d28bc req-9f306bf7-c3f7-4d71-9969-37e9951d55d4 tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a" returned: 0 in 0.399s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-d003aa8f-2102-4b6c-a6f1-11efc02d28bc req-9f306bf7-c3f7-4d71-9969-37e9951d55d4 tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.462s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:53:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-d003aa8f-2102-4b6c-a6f1-11efc02d28bc req-9f306bf7-c3f7-4d71-9969-37e9951d55d4 tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ac66d2a-0d88-4b0b-a39c-bf4741bfb035', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:53:14 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-d003aa8f-2102-4b6c-a6f1-11efc02d28bc req-9f306bf7-c3f7-4d71-9969-37e9951d55d4 tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:53:14 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-d003aa8f-2102-4b6c-a6f1-11efc02d28bc req-9f306bf7-c3f7-4d71-9969-37e9951d55d4 tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] attachment_update completed successfully. Sep 18 11:53:24 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=6 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:53:24 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:53:42 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Flow 'volume_create_manager' (10ea8c1f-e98f-4eb3-b567-8cb53c71d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686ab7e6-375c-4d39-babd-8e3eaa1f1e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686ab7e6-375c-4d39-babd-8e3eaa1f1e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1978356004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583f9f67-1bcb-4809-8ce2-eac514820f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159650fa986f4e399ff9f87ceeaf5dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:42Z,use_quota=True,user_id='4824eeb399f64d23bb4ce689dcdf909a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382da198-ceb1-4fc9-afd7-159c9570456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382da198-ceb1-4fc9-afd7-159c9570456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9f695d-9332-4e61-b6c6-38f59df5efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9f695d-9332-4e61-b6c6-38f59df5efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583f9f67-1bcb-4809-8ce2-eac514820f4f', 'volume_name': 'volume-583f9f67-1bcb-4809-8ce2-eac514820f4f', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48df1fd8-528b-4b92-8e87-e906191524f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48df1fd8-528b-4b92-8e87-e906191524f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006d9a07-4abd-48b6-8806-0dad9bea3032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:42 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Volume 583f9f67-1bcb-4809-8ce2-eac514820f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583f9f67-1bcb-4809-8ce2-eac514820f4f', 'volume_size': 1} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1978356004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583f9f67-1bcb-4809-8ce2-eac514820f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159650fa986f4e399ff9f87ceeaf5dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:53:42Z,use_quota=True,user_id='4824eeb399f64d23bb4ce689dcdf909a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Creating volume 583f9f67-1bcb-4809-8ce2-eac514820f4f {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:53:42 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:42 devstack quobyte-client[83210]: System call of process 95800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:53:42 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=92, name=volume-583f9f67-1bcb-4809-8ce2-eac514820f4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f 1073741824" returned: 0 in 0.345s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f" returned: 0 in 0.078s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] <== create_volume: return (488ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.499s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006d9a07-4abd-48b6-8806-0dad9bea3032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583f9f67-1bcb-4809-8ce2-eac514820f4f', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eef83a3-4bfb-4817-92c0-435489286503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:53:42 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Volume volume-583f9f67-1bcb-4809-8ce2-eac514820f4f (583f9f67-1bcb-4809-8ce2-eac514820f4f): created successfully Sep 18 11:53:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eef83a3-4bfb-4817-92c0-435489286503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:53:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Flow 'volume_create_manager' (10ea8c1f-e98f-4eb3-b567-8cb53c71d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:53:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-83281885-2ec3-45ef-9e9f-1fc660510a49 tempest-AttachVolumeNegativeTest-1100748550 None] Created volume successfully. Sep 18 11:53:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-01334bff-27da-422b-a7af-cfb8ceb2cb03 req-990eb3c2-730c-4f7f-82cb-1c0cdbd1f17a tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:53:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-01334bff-27da-422b-a7af-cfb8ceb2cb03 req-990eb3c2-730c-4f7f-82cb-1c0cdbd1f17a tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:53:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-01334bff-27da-422b-a7af-cfb8ceb2cb03 req-990eb3c2-730c-4f7f-82cb-1c0cdbd1f17a tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Terminate volume connection completed successfully. Sep 18 11:53:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-01334bff-27da-422b-a7af-cfb8ceb2cb03 req-990eb3c2-730c-4f7f-82cb-1c0cdbd1f17a tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Deleting attachment 7ac66d2a-0d88-4b0b-a39c-bf4741bfb035. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:53:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Acquiring lock "cinder-ce0cf2ef-cb0e-4728-990c-c599a486e62a-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:53:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "cinder-ce0cf2ef-cb0e-4728-990c-c599a486e62a-delete_volume" acquired by "delete_volume" :: waited 0.178s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:53:46 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:53:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Acquiring lock "cinder-quobyte-ce0cf2ef-cb0e-4728-990c-c599a486e62a" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:53:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "cinder-quobyte-ce0cf2ef-cb0e-4728-990c-c599a486e62a" acquired by "delete_volume" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:53:46 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eee12c2-99d2-4ad4-a111-3dd5326de555]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:53:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a" returned: 0 in 0.522s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-ce0cf2ef-cb0e-4728-990c-c599a486e62a" returned: 0 in 0.152s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "cinder-quobyte-ce0cf2ef-cb0e-4728-990c-c599a486e62a" released by "delete_volume" :: held 0.896s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-e2a8859a-06a2-4bfe-b6ee-a86b2ce189e0 req-882a5e75-2e0a-4de1-9671-4b0d65a66052 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-e2a8859a-06a2-4bfe-b6ee-a86b2ce189e0 req-882a5e75-2e0a-4de1-9671-4b0d65a66052 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55139e0-fd33-4358-ba59-52def1537e37]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-e2a8859a-06a2-4bfe-b6ee-a86b2ce189e0 req-882a5e75-2e0a-4de1-9671-4b0d65a66052 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Created reservations ['4bbea65a-cf58-412d-b636-8f92987b4553', '3a45026b-ae4b-43d1-b5a5-585062e115de', '0143d71f-0941-4d67-a8d2-2491cf07bce5', 'c22f5cb2-c72e-4046-9225-7b546160ff6d'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:53:48 devstack quobyte-client[83210]: System call of process 95820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:53:48 devstack quobyte-client[83210]: System call of process 95820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-e2a8859a-06a2-4bfe-b6ee-a86b2ce189e0 req-882a5e75-2e0a-4de1-9671-4b0d65a66052 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f" returned: 0 in 0.676s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-e2a8859a-06a2-4bfe-b6ee-a86b2ce189e0 req-882a5e75-2e0a-4de1-9671-4b0d65a66052 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.738s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:53:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.354s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:53:49 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:53:49 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Deleted volume successfully. Sep 18 11:53:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-e2a8859a-06a2-4bfe-b6ee-a86b2ce189e0 req-882a5e75-2e0a-4de1-9671-4b0d65a66052 tempest-AttachVolumeNegativeTest-1100748550 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-583f9f67-1bcb-4809-8ce2-eac514820f4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc79078f-b47d-4508-ad8a-b8c24e48f0fb', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 11:53:49 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-e2a8859a-06a2-4bfe-b6ee-a86b2ce189e0 req-882a5e75-2e0a-4de1-9671-4b0d65a66052 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:53:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c43c5c0-17f9-4431-9547-5bc84e4bdabb tempest-TestServerVolumeAttachScenarioOldVersion-26539795 None] Lock "cinder-ce0cf2ef-cb0e-4728-990c-c599a486e62a-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:53:49 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-e2a8859a-06a2-4bfe-b6ee-a86b2ce189e0 req-882a5e75-2e0a-4de1-9671-4b0d65a66052 tempest-AttachVolumeNegativeTest-1100748550 None] attachment_update completed successfully. Sep 18 11:53:59 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:53:59 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:54:18 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-87d5160c-aba2-47de-b86a-a9f7f4443c55 req-1c1d2a80-8a9c-4e68-9112-30e33f991d71 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:18 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-87d5160c-aba2-47de-b86a-a9f7f4443c55 req-1c1d2a80-8a9c-4e68-9112-30e33f991d71 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:18 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-87d5160c-aba2-47de-b86a-a9f7f4443c55 req-1c1d2a80-8a9c-4e68-9112-30e33f991d71 tempest-AttachVolumeNegativeTest-1100748550 None] Terminate volume connection completed successfully. Sep 18 11:54:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-87d5160c-aba2-47de-b86a-a9f7f4443c55 req-1c1d2a80-8a9c-4e68-9112-30e33f991d71 tempest-AttachVolumeNegativeTest-1100748550 None] Deleting attachment bc79078f-b47d-4508-ad8a-b8c24e48f0fb. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 11:54:20 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (97f4b92a-3333-4c23-9f53-7e7f8cfb7665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0dc672-d8d1-4c15-8f76-0499418b169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0dc672-d8d1-4c15-8f76-0499418b169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-982744156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7674da09-b6a2-47f9-96ea-b6c3306b8512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:20Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b45be43-1599-4618-a332-79222d0e1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b45be43-1599-4618-a332-79222d0e1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49883f63-9834-42d3-b0f7-154ee0cac1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49883f63-9834-42d3-b0f7-154ee0cac1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7674da09-b6a2-47f9-96ea-b6c3306b8512', 'volume_name': 'volume-7674da09-b6a2-47f9-96ea-b6c3306b8512', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231eecbd-6544-4c78-a996-181fa1f1ab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231eecbd-6544-4c78-a996-181fa1f1ab1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b222f0-118c-4b7d-9803-3da477715105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:20 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume 7674da09-b6a2-47f9-96ea-b6c3306b8512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7674da09-b6a2-47f9-96ea-b6c3306b8512', 'volume_size': 1} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-982744156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7674da09-b6a2-47f9-96ea-b6c3306b8512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:20Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Creating volume 7674da09-b6a2-47f9-96ea-b6c3306b8512 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:54:20 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:20 devstack quobyte-client[83210]: System call of process 96309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:54:20 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=93, name=volume-7674da09-b6a2-47f9-96ea-b6c3306b8512, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 1073741824" returned: 0 in 0.436s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512" returned: 0 in 0.150s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] <== create_volume: return (675ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:54:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b222f0-118c-4b7d-9803-3da477715105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7674da09-b6a2-47f9-96ea-b6c3306b8512', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0ec469-fa7e-494c-9b95-1ac393946210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:21 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 (7674da09-b6a2-47f9-96ea-b6c3306b8512): created successfully Sep 18 11:54:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0ec469-fa7e-494c-9b95-1ac393946210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (97f4b92a-3333-4c23-9f53-7e7f8cfb7665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:21 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4d1fe5a5-e58a-47ba-8aae-f08b8785e1c5 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created volume successfully. Sep 18 11:54:23 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Creating offline snapshot cd65f7f6-dbaa-45c1-9b31-7c257408c80e of volume 7674da09-b6a2-47f9-96ea-b6c3306b8512 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:54:23 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e520fb9f-624e-42bc-9eeb-e01d8fff71c9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512" returned: 0 in 0.465s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:24 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=94, name=volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e 1G" returned: 0 in 0.233s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img rebase -u -b volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e" returned: 0 in 0.167s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e" returned: 0 in 0.099s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e" returned: 0 in 0.098s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.info" returned: 0 in 0.104s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:54:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.info" returned: 0 in 0.090s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.663s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:25 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-249a5d33-4cd4-4199-90aa-07d096f58b01 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Create snapshot completed successfully Sep 18 11:54:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (ed9939d0-9ec8-4cb7-8ec1-b2b075b99475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fd67ae-cbbd-4844-91fd-70eb21c9a30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fd67ae-cbbd-4844-91fd-70eb21c9a30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622669533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:27Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3058d067-641b-494d-806f-88d68ecfb18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3058d067-641b-494d-806f-88d68ecfb18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3523803-7cc3-4808-a4d8-78d27e532cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3523803-7cc3-4808-a4d8-78d27e532cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf', 'volume_name': 'volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b68cc5-d515-4011-8d16-d97805dd4cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b68cc5-d515-4011-8d16-d97805dd4cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1dbe78-14e6-4cdc-8977-59b2fc90aa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:27 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf', 'volume_size': 1} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622669533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:27Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Creating volume a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:54:27 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:54:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:27 devstack quobyte-client[83210]: System call of process 96371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:54:27 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=96, name=volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf 1073741824" returned: 0 in 0.627s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:28 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (14551d3e-1040-4265-ba23-1ca372ae052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47d5944-edb2-44c3-8382-48e099e6a64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf" returned: 0 in 0.599s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] <== create_volume: return (1314ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47d5944-edb2-44c3-8382-48e099e6a64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-980561059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:28Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e592b6-26af-43e8-a6dd-01bb71f91d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e592b6-26af-43e8-a6dd-01bb71f91d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28771fa0-8b2d-461e-bc9e-d476f80a9313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28771fa0-8b2d-461e-bc9e-d476f80a9313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3', 'volume_name': 'volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec80abf4-63aa-4f0a-afef-7b45ff7a1d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec80abf4-63aa-4f0a-afef-7b45ff7a1d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafc4a3d-b56b-4d99-9feb-266bcb2d0f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:28 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume 4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3', 'volume_size': 1} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-980561059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:28Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Creating volume 4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:54:28 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:29 devstack quobyte-client[83210]: System call of process 96376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:54:29 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=97, name=volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1dbe78-14e6-4cdc-8977-59b2fc90aa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb0119b-550c-4b59-9c89-14d3a6ab557e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:29 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (107952ca-a6c6-46fe-ae55-ecc7c720a650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f4bb02-37d4-4784-8cc9-c46aded76d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:29 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf (a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf): created successfully Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb0119b-550c-4b59-9c89-14d3a6ab557e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (ed9939d0-9ec8-4cb7-8ec1-b2b075b99475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f4bb02-37d4-4784-8cc9-c46aded76d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34607195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55c84e9-de44-41b2-847f-7d6f0c2d341e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:28Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413bf753-c6ca-4083-86ca-6ba34a4591aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413bf753-c6ca-4083-86ca-6ba34a4591aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e13cf9-3f03-422b-b69f-637eec3e28e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e13cf9-3f03-422b-b69f-637eec3e28e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55c84e9-de44-41b2-847f-7d6f0c2d341e', 'volume_name': 'volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4af51c-63c6-4755-9cda-18721ebfec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4af51c-63c6-4755-9cda-18721ebfec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b1c135-76f4-4c73-974d-bcc96b45a4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:29 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume b55c84e9-de44-41b2-847f-7d6f0c2d341e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e', 'volume_size': 1} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3 1073741824" returned: 0 in 0.767s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (8193edcb-dea7-4eef-b9e9-20a124f16fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a5931c-3762-4aa0-8ce1-0fcf366fbde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:30 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-62d479ba-1e8c-4778-af39-7d2cea2bcfea tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created volume successfully. Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a5931c-3762-4aa0-8ce1-0fcf366fbde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-917740340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8c6668-1e6c-4980-884c-6dda7eb33119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:29Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3e796d-5941-4029-a0c2-e4e02f1e774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3e796d-5941-4029-a0c2-e4e02f1e774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36917d1a-4523-4610-b709-dec65cf66741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36917d1a-4523-4610-b709-dec65cf66741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8c6668-1e6c-4980-884c-6dda7eb33119', 'volume_name': 'volume-1b8c6668-1e6c-4980-884c-6dda7eb33119', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767eb9dd-ae91-420f-bd19-77a2b1d74e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767eb9dd-ae91-420f-bd19-77a2b1d74e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485638f4-f9b4-453b-9c93-7cc9609b8cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:30 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume 1b8c6668-1e6c-4980-884c-6dda7eb33119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8c6668-1e6c-4980-884c-6dda7eb33119', 'volume_size': 1} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3" returned: 0 in 0.618s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] <== create_volume: return (1409ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34607195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55c84e9-de44-41b2-847f-7d6f0c2d341e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:28Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Creating volume b55c84e9-de44-41b2-847f-7d6f0c2d341e {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:54:30 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:30 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=98, name=volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:54:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (b5b1a4c3-7d58-4c63-990d-1163beee588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd44400-e264-4c13-b109-07df299690e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd44400-e264-4c13-b109-07df299690e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424517292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df797cb-76b5-4ab9-ab9a-2648aa054758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:30Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c9dc47-9f88-4be7-861f-3cf71094abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c9dc47-9f88-4be7-861f-3cf71094abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619e46f6-f6c7-44d9-9ff3-9ab9016d29ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619e46f6-f6c7-44d9-9ff3-9ab9016d29ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df797cb-76b5-4ab9-ab9a-2648aa054758', 'volume_name': 'volume-7df797cb-76b5-4ab9-ab9a-2648aa054758', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e1ffb8-4e6f-40ab-9132-45ba3c9a31c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e1ffb8-4e6f-40ab-9132-45ba3c9a31c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52dade6-4521-4d22-9c76-715d0a5b7ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:31 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume 7df797cb-76b5-4ab9-ab9a-2648aa054758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df797cb-76b5-4ab9-ab9a-2648aa054758', 'volume_size': 1} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafc4a3d-b56b-4d99-9feb-266bcb2d0f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3150d2cb-0674-40c7-a6df-1bf851dc3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e 1073741824" returned: 0 in 0.656s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:31 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3 (4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3): created successfully Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3150d2cb-0674-40c7-a6df-1bf851dc3e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (14551d3e-1040-4265-ba23-1ca372ae052d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e" returned: 0 in 0.365s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] <== create_volume: return (1038ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-917740340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8c6668-1e6c-4980-884c-6dda7eb33119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:29Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Creating volume 1b8c6668-1e6c-4980-884c-6dda7eb33119 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:54:31 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1b8c6668-1e6c-4980-884c-6dda7eb33119 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:31 devstack quobyte-client[83210]: System call of process 96384 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:54:31 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=99, name=volume-1b8c6668-1e6c-4980-884c-6dda7eb33119, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:54:31 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e1841668-9823-4c6f-95f6-1c928eba8303 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created volume successfully. Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b1c135-76f4-4c73-974d-bcc96b45a4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550a23cc-4f3f-4962-a3bb-d4c6d3c5a9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1b8c6668-1e6c-4980-884c-6dda7eb33119 1073741824" returned: 0 in 0.427s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1b8c6668-1e6c-4980-884c-6dda7eb33119 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:32 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e (b55c84e9-de44-41b2-847f-7d6f0c2d341e): created successfully Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550a23cc-4f3f-4962-a3bb-d4c6d3c5a9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (107952ca-a6c6-46fe-ae55-ecc7c720a650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1b8c6668-1e6c-4980-884c-6dda7eb33119" returned: 0 in 0.346s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] <== create_volume: return (796ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.271s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424517292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df797cb-76b5-4ab9-ab9a-2648aa054758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053f41d34e384ce2ab5546f389bb28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:30Z,use_quota=True,user_id='3416d7b421324289a9be34026cc2ee57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Creating volume 7df797cb-76b5-4ab9-ab9a-2648aa054758 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:54:32 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7df797cb-76b5-4ab9-ab9a-2648aa054758 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:32 devstack quobyte-client[83210]: System call of process 96388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:54:32 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=100, name=volume-7df797cb-76b5-4ab9-ab9a-2648aa054758, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:54:32 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-72bc0ac9-46d7-4bf9-a916-07e969527772 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created volume successfully. Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485638f4-f9b4-453b-9c93-7cc9609b8cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8c6668-1e6c-4980-884c-6dda7eb33119', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae1fa18-5b10-4943-8018-0017ff3b4510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7df797cb-76b5-4ab9-ab9a-2648aa054758 1073741824" returned: 0 in 0.580s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7df797cb-76b5-4ab9-ab9a-2648aa054758 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:33 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume volume-1b8c6668-1e6c-4980-884c-6dda7eb33119 (1b8c6668-1e6c-4980-884c-6dda7eb33119): created successfully Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae1fa18-5b10-4943-8018-0017ff3b4510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (8193edcb-dea7-4eef-b9e9-20a124f16fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7df797cb-76b5-4ab9-ab9a-2648aa054758" returned: 0 in 0.367s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] <== create_volume: return (972ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:33 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9a39130f-bdc4-4e17-94c2-44ad0ece7ca6 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created volume successfully. Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52dade6-4521-4d22-9c76-715d0a5b7ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df797cb-76b5-4ab9-ab9a-2648aa054758', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdee3bc-8208-489c-9681-f8f4603f8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:33 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume volume-7df797cb-76b5-4ab9-ab9a-2648aa054758 (7df797cb-76b5-4ab9-ab9a-2648aa054758): created successfully Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdee3bc-8208-489c-9681-f8f4603f8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Flow 'volume_create_manager' (b5b1a4c3-7d58-4c63-990d-1163beee588b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:33 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-359f408e-bc6d-4793-a007-aceefbcb24bd tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created volume successfully. Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-7df797cb-76b5-4ab9-ab9a-2648aa054758-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "cinder-583f9f67-1bcb-4809-8ce2-eac514820f4f-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-583f9f67-1bcb-4809-8ce2-eac514820f4f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-7df797cb-76b5-4ab9-ab9a-2648aa054758-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:34 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "cinder-quobyte-583f9f67-1bcb-4809-8ce2-eac514820f4f" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:34 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-quobyte-7df797cb-76b5-4ab9-ab9a-2648aa054758" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-quobyte-583f9f67-1bcb-4809-8ce2-eac514820f4f" acquired by "delete_volume" :: waited 0.028s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-7df797cb-76b5-4ab9-ab9a-2648aa054758" acquired by "delete_volume" :: waited 0.036s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ce26f7-ae82-4079-befa-6378eba8d7c6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb64401-1854-4b40-a1d8-9c2249d98c0e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7df797cb-76b5-4ab9-ab9a-2648aa054758 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f" returned: 0 in 0.465s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7df797cb-76b5-4ab9-ab9a-2648aa054758" returned: 0 in 0.540s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7df797cb-76b5-4ab9-ab9a-2648aa054758 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-583f9f67-1bcb-4809-8ce2-eac514820f4f" returned: 0 in 0.205s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7df797cb-76b5-4ab9-ab9a-2648aa054758" returned: 0 in 0.145s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-quobyte-583f9f67-1bcb-4809-8ce2-eac514820f4f" released by "delete_volume" :: held 0.878s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-7df797cb-76b5-4ab9-ab9a-2648aa054758" released by "delete_volume" :: held 1.014s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Created reservations ['47af169d-da55-47c0-bb5a-f522d90d2307', 'd7da2b51-372b-4618-94ad-47c681d2919a', 'fe7d9a03-2ece-41ba-a859-fdc2f84c90be', '94f0f9b6-48fb-4979-a5a6-6cd7f89eccb6'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created reservations ['30a9e776-92af-4b00-8185-72ca9e72d6e0', '388f5fdb-c7a5-4a3e-bb0e-ad3f2a106d23', '8e5a7916-eff4-4f69-a5ae-0d521a4874f9', '9a2d6853-bb09-4e7f-b634-e43397634035'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.198s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:35 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Deleted volume successfully. Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e4b9e975-0c68-479e-a6cd-dbd75ceecef4 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-583f9f67-1bcb-4809-8ce2-eac514820f4f-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.240s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Deleted volume successfully. Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0940458b-0f0d-4ff9-a760-9c4cef78912e tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-7df797cb-76b5-4ab9-ab9a-2648aa054758-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-1b8c6668-1e6c-4980-884c-6dda7eb33119-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-1b8c6668-1e6c-4980-884c-6dda7eb33119-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "cinder-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:36 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-quobyte-1b8c6668-1e6c-4980-884c-6dda7eb33119" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-1b8c6668-1e6c-4980-884c-6dda7eb33119" acquired by "delete_volume" :: waited 0.042s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d2a9d-84b0-4fa9-841b-f1089440a8e6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1b8c6668-1e6c-4980-884c-6dda7eb33119 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "cinder-quobyte-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-quobyte-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13" acquired by "delete_volume" :: waited 0.074s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf1aa69-1397-4150-a090-0b1ebfe340b4]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1b8c6668-1e6c-4980-884c-6dda7eb33119" returned: 0 in 0.576s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1b8c6668-1e6c-4980-884c-6dda7eb33119 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1b8c6668-1e6c-4980-884c-6dda7eb33119" returned: 0 in 0.127s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-1b8c6668-1e6c-4980-884c-6dda7eb33119" released by "delete_volume" :: held 0.904s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13" returned: 0 in 0.590s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13" returned: 0 in 0.236s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-quobyte-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13" released by "delete_volume" :: held 0.997s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created reservations ['2d2d5e7e-0c07-425f-bee6-2636b6f1f8fa', '7c7bb625-8a73-45f9-8357-14bec034577c', '0ba80099-5107-4a76-8e9d-24f4a414d87b', 'f8edc811-07db-45ac-a669-b6b68fc84520'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Created reservations ['317a4929-ee63-4b79-b320-0b72ddabac4a', '8fdff3a6-d0a2-47b2-afb4-15be60177997', '4dd4e32f-99af-4ef9-a17e-48baecdc9d73', '5c182103-16c5-40d6-ba38-963c09eda385'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.298s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-b55c84e9-de44-41b2-847f-7d6f0c2d341e-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:38 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Deleted volume successfully. Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d528557c-3b10-41e3-b74c-a1ed566ee30c tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-1b8c6668-1e6c-4980-884c-6dda7eb33119-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-b55c84e9-de44-41b2-847f-7d6f0c2d341e-delete_volume" acquired by "delete_volume" :: waited 0.509s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.546s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "cinder-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:39 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Deleted volume successfully. Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:39 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-quobyte-b55c84e9-de44-41b2-847f-7d6f0c2d341e" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-db89ce6a-5758-4cc7-b2e2-187cf441bc15 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-baa2ed0a-375d-4ba2-bf27-c1d4cc74cb13-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-b55c84e9-de44-41b2-847f-7d6f0c2d341e" acquired by "delete_volume" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4706fb-f2a0-4a5a-81bf-cb0415de8cac]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:40 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "cinder-quobyte-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-quobyte-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad" acquired by "delete_volume" :: waited 0.080s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04031f6b-de77-4553-8433-0eb665500947]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e" returned: 0 in 0.528s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b55c84e9-de44-41b2-847f-7d6f0c2d341e" returned: 0 in 0.102s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-b55c84e9-de44-41b2-847f-7d6f0c2d341e" released by "delete_volume" :: held 0.864s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad" returned: 0 in 0.678s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad" returned: 0 in 0.244s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-quobyte-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad" released by "delete_volume" :: held 1.049s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created reservations ['59785e1e-ee37-4333-841d-e9f43d5aefe6', 'ad6c65e5-ebf0-4df0-b8d5-fab6f7fd1e5e', '16bb16bc-9764-44c5-bee2-efa598dc0442', '40787a44-5b72-474e-a57d-9ba3f4ac08f0'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Created reservations ['4deb96e5-7faa-44fa-8308-d9b0d9a428ca', '1e9e2386-611e-41db-aa52-bfbd33ca9fef', '9f763736-fe1d-4321-9ef5-6a42988dce40', '59fbc1aa-1ab6-404e-9db1-6c2e208e3a97'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.175s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:42 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Deleted volume successfully. Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-82d8fb4c-0ef6-4ae6-9d69-3a8583681ea9 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-b55c84e9-de44-41b2-847f-7d6f0c2d341e-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.503s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:42 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Deleted volume successfully. Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b2614f09-6c47-4c6e-bf7a-c7a9682c7700 tempest-AttachVolumeNegativeTest-1100748550 None] Lock "cinder-4b6fd2ed-3b91-41d7-a834-7dbabd3ccdad-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:42 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-quobyte-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3" acquired by "delete_volume" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad55c971-8df3-41ea-8f2e-0fe720b732e0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3" returned: 0 in 0.511s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3" returned: 0 in 0.107s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3" released by "delete_volume" :: held 0.800s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:43 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created reservations ['bf02f719-4277-4441-aeed-f16b9b3f93a3', 'a7cec877-0f82-4971-a5ef-d6e3baf342ad', 'a820b5c6-2612-4302-b03b-bdf5c1ae6169', '5c6c465c-58bb-4d62-a177-532efea9b4fd'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.101s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:44 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Deleted volume successfully. Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.165s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1d31b009-c68f-4b31-9f3f-02734ceeca68 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-4a3cb06c-2c64-4bf2-a7ee-4c6723a257d3-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:45 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-quobyte-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:45 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5848d9d1-dfa3-4018-86da-54a8f38dd2fe]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf" returned: 0 in 0.723s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf" returned: 0 in 0.132s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf" released by "delete_volume" :: held 1.079s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created reservations ['3301d2c1-6922-475a-9516-21c8a0b127fc', '8936bbc6-0175-457f-b20c-2f44aadbc3b6', 'cba1fd04-3c16-4c03-a4a3-70069d2b0c3a', '15709c5a-3d43-4435-ae3f-2c4d340619ed'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.103s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:46 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:46 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Deleted volume successfully. Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8bc2350f-28e6-4fc1-8beb-c1752f018b50 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-a25b39f3-49b8-49d1-a7b5-5eff34f6d1cf-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-cd65f7f6-dbaa-45c1-9b31-7c257408c80e-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-cd65f7f6-dbaa-45c1-9b31-7c257408c80e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:47 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-quobyte-7674da09-b6a2-47f9-96ea-b6c3306b8512" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-7674da09-b6a2-47f9-96ea-b6c3306b8512" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-quobyte-cd65f7f6-dbaa-45c1-9b31-7c257408c80e" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-cd65f7f6-dbaa-45c1-9b31-7c257408c80e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Deleting offline snapshot cd65f7f6-dbaa-45c1-9b31-7c257408c80e of volume 7674da09-b6a2-47f9-96ea-b6c3306b8512 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] snapshot_file for this snap is: volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a7ca12-3861-46dc-beaa-0f87ada33ac3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e" returned: 0 in 0.538s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7674da09-b6a2-47f9-96ea-b6c3306b8512(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:54:48 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9652d0-286d-4df9-a521-f8de4fdac244]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:48 devstack quobyte-client[83210]: System call of process 96471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:54:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512" returned: 0 in 0.614s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:49 devstack quobyte-client[83210]: System call of process 96474 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:54:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e" returned: 0 in 0.304s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512.cd65f7f6-dbaa-45c1-9b31-7c257408c80e" returned: 0 in 0.104s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-cd65f7f6-dbaa-45c1-9b31-7c257408c80e" released by "_delete_snapshot" :: held 1.971s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-7674da09-b6a2-47f9-96ea-b6c3306b8512" released by "delete_snapshot" :: held 2.002s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:49 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created reservations ['f70fe8db-db1f-4d0e-aefc-2ceeb3cb6516', 'f2a8ea24-5e22-45e0-b410-cc44143d48d1', '1fd558f6-1b9c-46a1-9d79-b55b7b1e622b', '785a5362-0ad7-4963-8da3-31cf6e9b7832'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:50 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Delete snapshot completed successfully. Sep 18 11:54:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-75cc4258-e9f9-430d-b172-4dad51c64726 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-cd65f7f6-dbaa-45c1-9b31-7c257408c80e-delete_snapshot" released by "delete_snapshot" :: held 2.648s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-7674da09-b6a2-47f9-96ea-b6c3306b8512-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-7674da09-b6a2-47f9-96ea-b6c3306b8512-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "cinder-quobyte-7674da09-b6a2-47f9-96ea-b6c3306b8512" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-7674da09-b6a2-47f9-96ea-b6c3306b8512" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:51 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb6f26-94f2-4cd9-8aa0-a6f5f947c2e8]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512" returned: 0 in 0.527s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7674da09-b6a2-47f9-96ea-b6c3306b8512" returned: 0 in 0.097s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-quobyte-7674da09-b6a2-47f9-96ea-b6c3306b8512" released by "delete_volume" :: held 0.808s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Created reservations ['8532af2e-7875-4f9f-9961-03f044fa6460', 'c14f14fe-b1a8-4eb8-9c38-37b39d59c895', '12d31584-4a48-42e0-aaf6-8700b0a7964d', '4928a4b8-e1d0-460c-a50e-bc64dc054782'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.091s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Deleted volume successfully. Sep 18 11:54:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0a105084-6452-4dc6-95aa-b0d9a2f8c1a8 tempest-CreateVolumesFromSnapshotTest-1723920766 None] Lock "cinder-7674da09-b6a2-47f9-96ea-b6c3306b8512-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:54 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:54 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:54:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Flow 'volume_create_manager' (455c1479-d329-4b1f-9a4d-6f6a25ffaa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace6c3d3-ec4d-4f53-b12c-ebccd8604465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace6c3d3-ec4d-4f53-b12c-ebccd8604465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1590683085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9955be8-564e-4e65-a1cb-1465d9b59b95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3897d21416e4f949afd256c108dfb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:54Z,use_quota=True,user_id='ebcd2906312a4b85adf02e1978014f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c78c7f-1380-4f40-943e-cdf4e2399c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c78c7f-1380-4f40-943e-cdf4e2399c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d61acb2-6772-411b-b97a-473f4e75281a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d61acb2-6772-411b-b97a-473f4e75281a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9955be8-564e-4e65-a1cb-1465d9b59b95', 'volume_name': 'volume-c9955be8-564e-4e65-a1cb-1465d9b59b95', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074a739b-53bd-46dd-9f65-9f7fa0d42be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074a739b-53bd-46dd-9f65-9f7fa0d42be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da282141-a40a-444a-954b-98e8d28eb753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:55 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Volume c9955be8-564e-4e65-a1cb-1465d9b59b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9955be8-564e-4e65-a1cb-1465d9b59b95', 'volume_size': 1} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1590683085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9955be8-564e-4e65-a1cb-1465d9b59b95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3897d21416e4f949afd256c108dfb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:54:54Z,use_quota=True,user_id='ebcd2906312a4b85adf02e1978014f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Creating volume c9955be8-564e-4e65-a1cb-1465d9b59b95 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:54:55 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9955be8-564e-4e65-a1cb-1465d9b59b95 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:55 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=101, name=volume-c9955be8-564e-4e65-a1cb-1465d9b59b95, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9955be8-564e-4e65-a1cb-1465d9b59b95 1073741824" returned: 0 in 0.486s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9955be8-564e-4e65-a1cb-1465d9b59b95 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9955be8-564e-4e65-a1cb-1465d9b59b95" returned: 0 in 0.122s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] <== create_volume: return (693ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:54:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da282141-a40a-444a-954b-98e8d28eb753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9955be8-564e-4e65-a1cb-1465d9b59b95', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec3c47a-65d1-4366-9f22-87e71162373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:54:56 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Volume volume-c9955be8-564e-4e65-a1cb-1465d9b59b95 (c9955be8-564e-4e65-a1cb-1465d9b59b95): created successfully Sep 18 11:54:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec3c47a-65d1-4366-9f22-87e71162373c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:54:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Flow 'volume_create_manager' (455c1479-d329-4b1f-9a4d-6f6a25ffaa80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:54:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-0274944d-15bb-4ba0-8e6a-79f8d0e74510 req-823f17b7-984b-4279-86f1-0da3b4f9e294 tempest-VolumesGetTestJSON-1278913209 None] Created volume successfully. Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Acquiring lock "cinder-c9955be8-564e-4e65-a1cb-1465d9b59b95-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Lock "cinder-c9955be8-564e-4e65-a1cb-1465d9b59b95-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Acquiring lock "cinder-quobyte-c9955be8-564e-4e65-a1cb-1465d9b59b95" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Lock "cinder-quobyte-c9955be8-564e-4e65-a1cb-1465d9b59b95" acquired by "delete_volume" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d148393-c8c3-4128-b8ad-521e7f3f5d99]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9955be8-564e-4e65-a1cb-1465d9b59b95 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9955be8-564e-4e65-a1cb-1465d9b59b95" returned: 0 in 0.434s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9955be8-564e-4e65-a1cb-1465d9b59b95 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c9955be8-564e-4e65-a1cb-1465d9b59b95" returned: 0 in 0.087s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Lock "cinder-quobyte-c9955be8-564e-4e65-a1cb-1465d9b59b95" released by "delete_volume" :: held 0.677s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG cinder.quota [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Created reservations ['87c80870-1f14-4ffd-81c8-09c481ab6cd3', 'e617cd38-c7a0-4278-b868-e19028179356', '0d1a7878-fc62-4efb-b98d-78e32e423d83', '7dc9c3fc-5b67-48d3-b0aa-90eea8db254d'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.097s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG cinder.manager [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:54:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Deleted volume successfully. Sep 18 11:54:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-7a718025-7dab-4b3e-a7ad-d2f8115590b4 req-b0606350-e0f3-4bdf-9fc3-0e0ab874a591 tempest-VolumesGetTestJSON-1278913209 None] Lock "cinder-c9955be8-564e-4e65-a1cb-1465d9b59b95-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:02 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Flow 'volume_create_manager' (361b91bf-a1a9-4833-9d66-6cf4796a5232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04346510-a5b3-413c-a8d4-49a70239dc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04346510-a5b3-413c-a8d4-49a70239dc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1423162700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f1a837-efb9-41be-8c85-0f458f23a86c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42ade3c72255453abc103c61f1998b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:02Z,use_quota=True,user_id='69ac54924fb54fa2915cc9b53c6c7466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706a75e-b2bc-4726-a64e-224d7271172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706a75e-b2bc-4726-a64e-224d7271172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804c391c-3bf9-460c-966e-a72b8d637961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804c391c-3bf9-460c-966e-a72b8d637961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f1a837-efb9-41be-8c85-0f458f23a86c', 'volume_name': 'volume-c0f1a837-efb9-41be-8c85-0f458f23a86c', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e09f9ee-33e5-446a-99f8-801f13b70d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e09f9ee-33e5-446a-99f8-801f13b70d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039fefe1-b394-46d3-b129-ad48119fd129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Volume c0f1a837-efb9-41be-8c85-0f458f23a86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f1a837-efb9-41be-8c85-0f458f23a86c', 'volume_size': 1} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1423162700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f1a837-efb9-41be-8c85-0f458f23a86c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42ade3c72255453abc103c61f1998b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:02Z,use_quota=True,user_id='69ac54924fb54fa2915cc9b53c6c7466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Creating volume c0f1a837-efb9-41be-8c85-0f458f23a86c {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:55:02 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0f1a837-efb9-41be-8c85-0f458f23a86c 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:02 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=102, name=volume-c0f1a837-efb9-41be-8c85-0f458f23a86c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:55:02 devstack quobyte-client[83210]: System call of process 96503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0f1a837-efb9-41be-8c85-0f458f23a86c 1073741824" returned: 0 in 0.360s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0f1a837-efb9-41be-8c85-0f458f23a86c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0f1a837-efb9-41be-8c85-0f458f23a86c" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:55:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.557s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039fefe1-b394-46d3-b129-ad48119fd129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f1a837-efb9-41be-8c85-0f458f23a86c', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d892f159-a44b-4145-b464-859fa332cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:03 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Volume volume-c0f1a837-efb9-41be-8c85-0f458f23a86c (c0f1a837-efb9-41be-8c85-0f458f23a86c): created successfully Sep 18 11:55:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d892f159-a44b-4145-b464-859fa332cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Flow 'volume_create_manager' (361b91bf-a1a9-4833-9d66-6cf4796a5232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:03 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cd1669f2-3334-4b24-b086-ecd73c7216cc tempest-VolumesTestJSON-1217036060 None] Created volume successfully. Sep 18 11:55:04 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Flow 'volume_create_manager' (5c15257d-a0fa-4f93-b707-ba208c205505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f50a16-3953-4596-ba18-b56ae0586144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f50a16-3953-4596-ba18-b56ae0586144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-117686260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b52735-7528-4e85-96e0-3d2448597ecf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42ade3c72255453abc103c61f1998b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:05Z,use_quota=True,user_id='69ac54924fb54fa2915cc9b53c6c7466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750a7fb0-4ca3-46a4-98aa-69dfc63c3db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750a7fb0-4ca3-46a4-98aa-69dfc63c3db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfaa19e-f997-442b-955b-23a7832c30bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfaa19e-f997-442b-955b-23a7832c30bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b52735-7528-4e85-96e0-3d2448597ecf', 'volume_name': 'volume-64b52735-7528-4e85-96e0-3d2448597ecf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be53256b-6a4c-40d6-84a1-c7b725b60f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be53256b-6a4c-40d6-84a1-c7b725b60f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57055534-cada-4599-8a86-3df8d2b61e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:04 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Volume 64b52735-7528-4e85-96e0-3d2448597ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b52735-7528-4e85-96e0-3d2448597ecf', 'volume_size': 1} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-117686260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b52735-7528-4e85-96e0-3d2448597ecf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42ade3c72255453abc103c61f1998b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:05Z,use_quota=True,user_id='69ac54924fb54fa2915cc9b53c6c7466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Creating volume 64b52735-7528-4e85-96e0-3d2448597ecf {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:55:04 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:55:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-64b52735-7528-4e85-96e0-3d2448597ecf 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:05 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=103, name=volume-64b52735-7528-4e85-96e0-3d2448597ecf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-64b52735-7528-4e85-96e0-3d2448597ecf 1073741824" returned: 0 in 0.329s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-64b52735-7528-4e85-96e0-3d2448597ecf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-64b52735-7528-4e85-96e0-3d2448597ecf" returned: 0 in 0.087s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] <== create_volume: return (483ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.497s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57055534-cada-4599-8a86-3df8d2b61e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b52735-7528-4e85-96e0-3d2448597ecf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d95a51c-b575-48be-aa60-b13f216b3edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:05 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Volume volume-64b52735-7528-4e85-96e0-3d2448597ecf (64b52735-7528-4e85-96e0-3d2448597ecf): created successfully Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d95a51c-b575-48be-aa60-b13f216b3edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Flow 'volume_create_manager' (5c15257d-a0fa-4f93-b707-ba208c205505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-00c274fb-7302-4211-afa8-8a986e612353 tempest-VolumesTestJSON-1217036060 None] Created volume successfully. Sep 18 11:55:07 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Flow 'volume_create_manager' (a34e8777-64f1-408c-94bd-e8fb68cc08d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d839815f-171e-4d20-b12e-a6a5279fb738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d839815f-171e-4d20-b12e-a6a5279fb738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1595779958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0f8082-6783-4b00-8e2f-c2744f98c60c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42ade3c72255453abc103c61f1998b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:08Z,use_quota=True,user_id='69ac54924fb54fa2915cc9b53c6c7466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a07bbb4-feae-4d17-9ce6-ff61bb4f625a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a07bbb4-feae-4d17-9ce6-ff61bb4f625a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bc8bba-f314-48cd-9038-33c78d871275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bc8bba-f314-48cd-9038-33c78d871275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0f8082-6783-4b00-8e2f-c2744f98c60c', 'volume_name': 'volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968271a3-aee0-4579-9842-1f8c0db9de43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968271a3-aee0-4579-9842-1f8c0db9de43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae0e71d-e1b1-45e4-927f-ab8b7169be6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:07 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Volume 0d0f8082-6783-4b00-8e2f-c2744f98c60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c', 'volume_size': 1} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1595779958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0f8082-6783-4b00-8e2f-c2744f98c60c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42ade3c72255453abc103c61f1998b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:08Z,use_quota=True,user_id='69ac54924fb54fa2915cc9b53c6c7466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Creating volume 0d0f8082-6783-4b00-8e2f-c2744f98c60c {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:55:07 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:55:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:08 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=104, name=volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c 1073741824" returned: 0 in 0.389s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c" returned: 0 in 0.130s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] <== create_volume: return (643ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae0e71d-e1b1-45e4-927f-ab8b7169be6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001eff4d-0176-4ebd-baa7-7316997fefb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:08 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Volume volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c (0d0f8082-6783-4b00-8e2f-c2744f98c60c): created successfully Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001eff4d-0176-4ebd-baa7-7316997fefb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Flow 'volume_create_manager' (a34e8777-64f1-408c-94bd-e8fb68cc08d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:08 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-028e68ab-a342-4687-9138-8cae39baf279 tempest-VolumesTestJSON-1217036060 None] Created volume successfully. Sep 18 11:55:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Acquiring lock "cinder-0d0f8082-6783-4b00-8e2f-c2744f98c60c-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Lock "cinder-0d0f8082-6783-4b00-8e2f-c2744f98c60c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:10 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=59,cinder:UPDATE=88,cinder:DELETE=14,cinder:INSERT=26 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:55:10 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=76,cinder:UPDATE=126,cinder:DELETE=7,cinder:INSERT=18 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:55:10 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Acquiring lock "cinder-quobyte-0d0f8082-6783-4b00-8e2f-c2744f98c60c" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Lock "cinder-quobyte-0d0f8082-6783-4b00-8e2f-c2744f98c60c" acquired by "delete_volume" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:10 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e8a248-fe90-4440-8b9a-08d36008c831]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:55:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c" returned: 0 in 0.441s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0d0f8082-6783-4b00-8e2f-c2744f98c60c" returned: 0 in 0.098s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Lock "cinder-quobyte-0d0f8082-6783-4b00-8e2f-c2744f98c60c" released by "delete_volume" :: held 0.701s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:11 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Created reservations ['63795028-d503-41e7-97a2-3a2a34840d96', '4d6b85cd-e8eb-4279-9dd3-bae4b8ca293a', 'e7110cdf-8478-49e2-bcf3-cca4f059667e', '6fd94c99-146c-41ff-a65c-cbc12a4124dc'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.083s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:55:12 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Deleted volume successfully. Sep 18 11:55:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-79d3c2b5-1bec-42fa-b473-f28476d8bf9b tempest-VolumesTestJSON-1217036060 None] Lock "cinder-0d0f8082-6783-4b00-8e2f-c2744f98c60c-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Acquiring lock "cinder-64b52735-7528-4e85-96e0-3d2448597ecf-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Lock "cinder-64b52735-7528-4e85-96e0-3d2448597ecf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:13 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Acquiring lock "cinder-quobyte-64b52735-7528-4e85-96e0-3d2448597ecf" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Lock "cinder-quobyte-64b52735-7528-4e85-96e0-3d2448597ecf" acquired by "delete_volume" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59081f6-ec1b-4fe7-9aa2-4ea57ae5eaaa]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-64b52735-7528-4e85-96e0-3d2448597ecf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-64b52735-7528-4e85-96e0-3d2448597ecf" returned: 0 in 0.398s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-64b52735-7528-4e85-96e0-3d2448597ecf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-64b52735-7528-4e85-96e0-3d2448597ecf" returned: 0 in 0.111s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Lock "cinder-quobyte-64b52735-7528-4e85-96e0-3d2448597ecf" released by "delete_volume" :: held 0.652s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Created reservations ['96da749e-904d-478b-9fff-7de127d6caec', 'ba022e64-7caa-47aa-9e2d-cc38443ce44c', 'ad3b3de4-1abd-4e21-973b-58e7d94022df', 'c75fee61-130d-48d9-b1ba-48b3effcd4a6'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.111s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:55:14 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Deleted volume successfully. Sep 18 11:55:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e8aee911-51fb-4510-b86f-f94b38fb57ca tempest-VolumesTestJSON-1217036060 None] Lock "cinder-64b52735-7528-4e85-96e0-3d2448597ecf-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Acquiring lock "cinder-c0f1a837-efb9-41be-8c85-0f458f23a86c-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Lock "cinder-c0f1a837-efb9-41be-8c85-0f458f23a86c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:15 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Acquiring lock "cinder-quobyte-c0f1a837-efb9-41be-8c85-0f458f23a86c" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Lock "cinder-quobyte-c0f1a837-efb9-41be-8c85-0f458f23a86c" acquired by "delete_volume" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:15 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccecf02-adf0-45a3-aaa3-80bedc406a5e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:55:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0f1a837-efb9-41be-8c85-0f458f23a86c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0f1a837-efb9-41be-8c85-0f458f23a86c" returned: 0 in 0.401s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0f1a837-efb9-41be-8c85-0f458f23a86c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0f1a837-efb9-41be-8c85-0f458f23a86c" returned: 0 in 0.091s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Lock "cinder-quobyte-c0f1a837-efb9-41be-8c85-0f458f23a86c" released by "delete_volume" :: held 0.639s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Created reservations ['5ba8135e-6a86-410b-ad28-9a27a9376da6', '8d5e3338-e35e-433a-bc0c-955472400311', '800f5159-6974-4ee2-bd2e-264919efde71', '860546b3-1802-417e-bffa-a54d15c31987'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:16 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:55:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Deleted volume successfully. Sep 18 11:55:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-6e212162-220c-4577-91b4-3ea201f978cc tempest-VolumesTestJSON-1217036060 None] Lock "cinder-c0f1a837-efb9-41be-8c85-0f458f23a86c-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:21 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-164b77c8-f206-41cd-ab69-94c5cfde175a tempest-GroupsV320Test-2086365210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:21 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-164b77c8-f206-41cd-ab69-94c5cfde175a tempest-GroupsV320Test-2086365210 None] Group tempest-GroupsV320Test-Group-681638195: creating Sep 18 11:55:21 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-164b77c8-f206-41cd-ab69-94c5cfde175a tempest-GroupsV320Test-2086365210 None] Group tempest-GroupsV320Test-Group-681638195: created successfully Sep 18 11:55:21 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-164b77c8-f206-41cd-ab69-94c5cfde175a tempest-GroupsV320Test-2086365210 None] Create group completed successfully. Sep 18 11:55:23 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Created reservations ['6ed53c2c-0043-4fba-9267-ac1221204bf4'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.193s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:23 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:55:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-c9495f4a-607b-4850-9f4d-a03900f4bec2 tempest-GroupsV320Test-2086365210 None] Delete group completed successfully. Sep 18 11:55:33 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=34 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:55:33 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:55:38 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Flow 'volume_create_manager' (61be4a62-fd46-46d2-9de6-3cdb137a2ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe6b675-be79-4046-b298-be2e74389a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe6b675-be79-4046-b298-be2e74389a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-522318548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd86706-2fd8-40e5-8081-b9fba547a424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad8b2f4ba8c49b189cc43c2452dd406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:38Z,use_quota=True,user_id='a7a7a998018d46078d72a1dc5ddca7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67484338-fbfa-4132-9c12-470299808672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67484338-fbfa-4132-9c12-470299808672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8134f29e-4f1f-44a6-a198-a45dadebf226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8134f29e-4f1f-44a6-a198-a45dadebf226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd86706-2fd8-40e5-8081-b9fba547a424', 'volume_name': 'volume-cdd86706-2fd8-40e5-8081-b9fba547a424', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fb0584-0411-450d-8e3b-8b19797c3f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fb0584-0411-450d-8e3b-8b19797c3f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9bbed3-fb19-4bf4-9c89-efb2f4fbe918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:38 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume cdd86706-2fd8-40e5-8081-b9fba547a424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd86706-2fd8-40e5-8081-b9fba547a424', 'volume_size': 1} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-522318548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd86706-2fd8-40e5-8081-b9fba547a424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad8b2f4ba8c49b189cc43c2452dd406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:38Z,use_quota=True,user_id='a7a7a998018d46078d72a1dc5ddca7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Creating volume cdd86706-2fd8-40e5-8081-b9fba547a424 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:55:38 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:55:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cdd86706-2fd8-40e5-8081-b9fba547a424 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:38 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=105, name=volume-cdd86706-2fd8-40e5-8081-b9fba547a424, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cdd86706-2fd8-40e5-8081-b9fba547a424 1073741824" returned: 0 in 0.363s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cdd86706-2fd8-40e5-8081-b9fba547a424 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cdd86706-2fd8-40e5-8081-b9fba547a424" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] <== create_volume: return (508ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.520s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9bbed3-fb19-4bf4-9c89-efb2f4fbe918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd86706-2fd8-40e5-8081-b9fba547a424', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40fd5fcd-f71c-49be-895e-80ef4f87e397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:39 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume volume-cdd86706-2fd8-40e5-8081-b9fba547a424 (cdd86706-2fd8-40e5-8081-b9fba547a424): created successfully Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40fd5fcd-f71c-49be-895e-80ef4f87e397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Flow 'volume_create_manager' (61be4a62-fd46-46d2-9de6-3cdb137a2ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:39 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-aaf0b81a-0dfd-496e-8e9d-d7199dba97d1 tempest-VolumeQuotasAdminTestJSON-598573936 None] Created volume successfully. Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Acquiring lock "cinder-cdd86706-2fd8-40e5-8081-b9fba547a424-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "cinder-cdd86706-2fd8-40e5-8081-b9fba547a424-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:41 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Acquiring lock "cinder-quobyte-cdd86706-2fd8-40e5-8081-b9fba547a424" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "cinder-quobyte-cdd86706-2fd8-40e5-8081-b9fba547a424" acquired by "delete_volume" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebebd13-17e1-486b-b52f-72cc1e202299]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cdd86706-2fd8-40e5-8081-b9fba547a424 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cdd86706-2fd8-40e5-8081-b9fba547a424" returned: 0 in 0.424s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cdd86706-2fd8-40e5-8081-b9fba547a424 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cdd86706-2fd8-40e5-8081-b9fba547a424" returned: 0 in 0.089s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "cinder-quobyte-cdd86706-2fd8-40e5-8081-b9fba547a424" released by "delete_volume" :: held 0.660s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Created reservations ['8e1bac0a-75d4-40ab-8498-f388fdc1c569', '4f5c0750-5868-40f0-8ae2-657d39804f09', '2b70be31-4a2c-49a1-bb6b-3f71c0896daf', '7f345508-8b88-4708-aba6-c39649d67234'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.152s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:55:42 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Deleted volume successfully. Sep 18 11:55:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-53ae5c19-3543-455d-ba9c-afa48269f84c tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "cinder-cdd86706-2fd8-40e5-8081-b9fba547a424-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:43 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:55:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Flow 'volume_create_manager' (ddda0a13-fe2d-459c-b29a-199d26ec6b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589101ee-6e0f-46a3-b4cd-948acfb68113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589101ee-6e0f-46a3-b4cd-948acfb68113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-567396765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63299428-b1a9-415c-9933-307b5f715d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad8b2f4ba8c49b189cc43c2452dd406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:44Z,use_quota=True,user_id='a7a7a998018d46078d72a1dc5ddca7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d228b4-bfa5-4009-a1c3-faa515035b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d228b4-bfa5-4009-a1c3-faa515035b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba28155-6382-471a-acec-1a7289467492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba28155-6382-471a-acec-1a7289467492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63299428-b1a9-415c-9933-307b5f715d58', 'volume_name': 'volume-63299428-b1a9-415c-9933-307b5f715d58', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f326547e-5129-41ae-b4b9-58740d50ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f326547e-5129-41ae-b4b9-58740d50ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97db0e94-d15a-4b05-beb8-3828bec477d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:44 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume 63299428-b1a9-415c-9933-307b5f715d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63299428-b1a9-415c-9933-307b5f715d58', 'volume_size': 1} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-567396765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63299428-b1a9-415c-9933-307b5f715d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad8b2f4ba8c49b189cc43c2452dd406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:44Z,use_quota=True,user_id='a7a7a998018d46078d72a1dc5ddca7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Creating volume 63299428-b1a9-415c-9933-307b5f715d58 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:55:44 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-63299428-b1a9-415c-9933-307b5f715d58 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:44 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=106, name=volume-63299428-b1a9-415c-9933-307b5f715d58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-63299428-b1a9-415c-9933-307b5f715d58 1073741824" returned: 0 in 0.432s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-63299428-b1a9-415c-9933-307b5f715d58 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.172s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-63299428-b1a9-415c-9933-307b5f715d58" returned: 0 in 0.215s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] <== create_volume: return (709ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97db0e94-d15a-4b05-beb8-3828bec477d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63299428-b1a9-415c-9933-307b5f715d58', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b39eb93-860a-4bc6-9bad-302be42969e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:44 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Volume volume-63299428-b1a9-415c-9933-307b5f715d58 (63299428-b1a9-415c-9933-307b5f715d58): created successfully Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b39eb93-860a-4bc6-9bad-302be42969e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Flow 'volume_create_manager' (ddda0a13-fe2d-459c-b29a-199d26ec6b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ea7b37a9-9f5f-47ef-913e-1d06588f4717 tempest-VolumeQuotasAdminTestJSON-598573936 None] Created volume successfully. Sep 18 11:55:46 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-674a3b76-37de-4698-897e-a5688af276fd tempest-VolumeQuotasAdminTestJSON-924413797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:46 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-674a3b76-37de-4698-897e-a5688af276fd tempest-VolumeQuotasAdminTestJSON-924413797 None] Transfer volume completed successfully. Sep 18 11:55:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Acquiring lock "cinder-63299428-b1a9-415c-9933-307b5f715d58-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Lock "cinder-63299428-b1a9-415c-9933-307b5f715d58-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:47 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Acquiring lock "cinder-quobyte-63299428-b1a9-415c-9933-307b5f715d58" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:55:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Lock "cinder-quobyte-63299428-b1a9-415c-9933-307b5f715d58" acquired by "delete_volume" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:55:47 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e57a07-d004-40c1-9df3-db608afaaab2]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:55:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-63299428-b1a9-415c-9933-307b5f715d58 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-63299428-b1a9-415c-9933-307b5f715d58" returned: 0 in 0.422s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-63299428-b1a9-415c-9933-307b5f715d58 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-63299428-b1a9-415c-9933-307b5f715d58" returned: 0 in 0.115s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Lock "cinder-quobyte-63299428-b1a9-415c-9933-307b5f715d58" released by "delete_volume" :: held 0.691s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Created reservations ['0f0f133e-46be-4a90-9c1f-1d296660b107', '8458edcc-8149-43de-b860-225566544e08', 'ec4f2658-60c2-4dbb-aca6-81ba18138538', 'ade835ba-482b-4c4b-b511-643afe5b3996'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.159s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:49 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:55:49 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Deleted volume successfully. Sep 18 11:55:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d22c2d90-e82f-4f76-a0b7-cd2f9cc95e23 tempest-VolumeQuotasAdminTestJSON-365029859 None] Lock "cinder-63299428-b1a9-415c-9933-307b5f715d58-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:55:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Flow 'volume_create_manager' (ecea7a97-72a1-4ecb-ba56-9526ef33f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ca847d-f70a-458f-a7f8-f578a4d05a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ca847d-f70a-458f-a7f8-f578a4d05a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1657044021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403d5bbc-cab6-46ff-bc55-e85fadf39ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e076e0f25745414f87802e4081e53975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:57Z,use_quota=True,user_id='dc56cf725a114d8cb9647c4bd52fe560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a55f096b-8118-4aae-a204-bcb883f37945),volume_type_id=a55f096b-8118-4aae-a204-bcb883f37945)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d65fa7-4395-458c-a28c-782bd35f5a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d65fa7-4395-458c-a28c-782bd35f5a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d62fd43-91ed-47ce-aa5d-963b2903e2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d62fd43-91ed-47ce-aa5d-963b2903e2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403d5bbc-cab6-46ff-bc55-e85fadf39ad3', 'volume_name': 'volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e011831-a1b6-4369-afd9-72c3dba09b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e011831-a1b6-4369-afd9-72c3dba09b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dac5b78-88b8-4238-a1d5-13291da80141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:56 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Volume 403d5bbc-cab6-46ff-bc55-e85fadf39ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3', 'volume_size': 1} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1657044021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403d5bbc-cab6-46ff-bc55-e85fadf39ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e076e0f25745414f87802e4081e53975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:55:57Z,use_quota=True,user_id='dc56cf725a114d8cb9647c4bd52fe560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a55f096b-8118-4aae-a204-bcb883f37945),volume_type_id=a55f096b-8118-4aae-a204-bcb883f37945)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Creating volume 403d5bbc-cab6-46ff-bc55-e85fadf39ad3 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:55:57 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:57 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=107, name=volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3 1073741824" returned: 0 in 0.375s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] <== create_volume: return (525ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.536s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dac5b78-88b8-4238-a1d5-13291da80141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655703d4-47e6-40a8-9768-9c4ce332269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:55:57 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Volume volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3 (403d5bbc-cab6-46ff-bc55-e85fadf39ad3): created successfully Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655703d4-47e6-40a8-9768-9c4ce332269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:55:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Flow 'volume_create_manager' (ecea7a97-72a1-4ecb-ba56-9526ef33f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:55:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3c0129ff-4594-44db-bd93-5c611e7c7e7f tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Created volume successfully. Sep 18 11:55:59 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:55:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:55:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:55:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:55:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:55:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:55:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:55:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.106s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:55:59 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:55:59 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-00342ce6-de37-48d1-88b3-0a27ce0fe78e tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Retype volume completed successfully. Sep 18 11:56:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Acquiring lock "cinder-403d5bbc-cab6-46ff-bc55-e85fadf39ad3-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "cinder-403d5bbc-cab6-46ff-bc55-e85fadf39ad3-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:01 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:56:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Acquiring lock "cinder-quobyte-403d5bbc-cab6-46ff-bc55-e85fadf39ad3" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "cinder-quobyte-403d5bbc-cab6-46ff-bc55-e85fadf39ad3" acquired by "delete_volume" :: waited 0.010s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:01 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c416526-e5c2-4ead-9030-536b17d3764d]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:56:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3" returned: 0 in 0.394s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-403d5bbc-cab6-46ff-bc55-e85fadf39ad3" returned: 0 in 0.110s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "cinder-quobyte-403d5bbc-cab6-46ff-bc55-e85fadf39ad3" released by "delete_volume" :: held 0.654s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:02 devstack cinder-volume[83184]: WARNING cinder.quota [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:56:02 devstack cinder-volume[83184]: WARNING cinder.quota [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Created reservations ['7363f340-65a2-40ff-8ab6-c6ea3fa94a2d', '1bf732db-8ac7-4522-b386-38846b5109d2', '5c1d92a7-6f98-46c9-8083-1c21634e7c1d', '1447f93f-5a66-4d52-a402-2ab46412435d'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:56:03 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Deleted volume successfully. Sep 18 11:56:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-24eb9582-a13f-4930-8e53-d5caf43db65b tempest-VolumeRetypeWithoutMigrationTest-1903997594 None] Lock "cinder-403d5bbc-cab6-46ff-bc55-e85fadf39ad3-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:13 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=24,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=10 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:56:13 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:56:14 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Flow 'volume_create_manager' (d58e4598-ac58-41a8-8ef3-6b709fa2813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb70d25-7896-4c45-887c-264c435c567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb70d25-7896-4c45-887c-264c435c567b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-89242699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932ae6e6-1951-4a16-8d1e-836d6459e949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d43fb698504460949c67b5429289ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:56:14Z,use_quota=True,user_id='bf2075252fe54a8492eafa61a6a63c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495d32ce-6ff7-44ae-bff1-d90e8fb9d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495d32ce-6ff7-44ae-bff1-d90e8fb9d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041f912e-0309-49ef-805b-b1924c7bf722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041f912e-0309-49ef-805b-b1924c7bf722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932ae6e6-1951-4a16-8d1e-836d6459e949', 'volume_name': 'volume-932ae6e6-1951-4a16-8d1e-836d6459e949', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e424c4ad-4d9a-403f-9761-00ddc62ee654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e424c4ad-4d9a-403f-9761-00ddc62ee654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03565d3-99e8-4b6b-a320-094a4824232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:14 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Volume 932ae6e6-1951-4a16-8d1e-836d6459e949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932ae6e6-1951-4a16-8d1e-836d6459e949', 'volume_size': 1} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-89242699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932ae6e6-1951-4a16-8d1e-836d6459e949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d43fb698504460949c67b5429289ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:56:14Z,use_quota=True,user_id='bf2075252fe54a8492eafa61a6a63c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Creating volume 932ae6e6-1951-4a16-8d1e-836d6459e949 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:56:14 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:56:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:14 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=108, name=volume-932ae6e6-1951-4a16-8d1e-836d6459e949, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 1073741824" returned: 0 in 0.532s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949" returned: 0 in 0.156s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] <== create_volume: return (777ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03565d3-99e8-4b6b-a320-094a4824232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932ae6e6-1951-4a16-8d1e-836d6459e949', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cead92-a774-4b65-ab99-180c0c2cdf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:15 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Volume volume-932ae6e6-1951-4a16-8d1e-836d6459e949 (932ae6e6-1951-4a16-8d1e-836d6459e949): created successfully Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cead92-a774-4b65-ab99-180c0c2cdf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Flow 'volume_create_manager' (d58e4598-ac58-41a8-8ef3-6b709fa2813d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:56:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b284262d-4603-4530-a608-947a45b4c8f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Created volume successfully. Sep 18 11:56:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:56:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Creating offline snapshot 5d8559d3-b27d-4c13-9b5a-9c68785feffc of volume 932ae6e6-1951-4a16-8d1e-836d6459e949 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:56:17 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[823a7998-0601-451b-9c97-60af2de7267a]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:56:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:17 devstack quobyte-client[83210]: System call of process 96845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:56:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949" returned: 0 in 0.574s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:17 devstack quobyte-client[83210]: System call of process 96848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:56:17 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=109, name=volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc 1G" returned: 0 in 0.455s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): qemu-img rebase -u -b volume-932ae6e6-1951-4a16-8d1e-836d6459e949 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "qemu-img rebase -u -b volume-932ae6e6-1951-4a16-8d1e-836d6459e949 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc" returned: 0 in 0.210s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc" returned: 0 in 0.109s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc" returned: 0 in 0.121s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.info" returned: 0 in 0.194s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:56:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.info" returned: 0 in 0.107s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:20 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2925bb55-9e28-4d00-a26a-6d6e1acdd653 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Create snapshot completed successfully Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "cinder-5d8559d3-b27d-4c13-9b5a-9c68785feffc-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-5d8559d3-b27d-4c13-9b5a-9c68785feffc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:21 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "cinder-quobyte-932ae6e6-1951-4a16-8d1e-836d6459e949" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-quobyte-932ae6e6-1951-4a16-8d1e-836d6459e949" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "cinder-quobyte-5d8559d3-b27d-4c13-9b5a-9c68785feffc" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-quobyte-5d8559d3-b27d-4c13-9b5a-9c68785feffc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Deleting offline snapshot 5d8559d3-b27d-4c13-9b5a-9c68785feffc of volume 932ae6e6-1951-4a16-8d1e-836d6459e949 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] snapshot_file for this snap is: volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d1540b-d222-4e9b-b897-4289d39e93e8]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:56:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc" returned: 0 in 0.390s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932ae6e6-1951-4a16-8d1e-836d6459e949(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5959df06-aedf-483d-8768-5f3d9b652ffa]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949" returned: 0 in 0.387s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc" returned: 0 in 0.184s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949.5d8559d3-b27d-4c13-9b5a-9c68785feffc" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:22 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-quobyte-5d8559d3-b27d-4c13-9b5a-9c68785feffc" released by "_delete_snapshot" :: held 1.357s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-quobyte-932ae6e6-1951-4a16-8d1e-836d6459e949" released by "delete_snapshot" :: held 1.385s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:23 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Created reservations ['d14bb3ac-cc7c-469c-b924-4b18d89e26b0', '551fb061-3186-4a1f-a8c7-31ca05c08050', '2c6fa990-6895-47ed-94c8-ca2f18d2db63', '3b65c132-f13d-4eb7-a51c-5c62cd3ba282'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:56:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Delete snapshot completed successfully. Sep 18 11:56:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-20fc58d2-6c51-466c-9fb0-717acdcc4d34 tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-5d8559d3-b27d-4c13-9b5a-9c68785feffc-delete_snapshot" released by "delete_snapshot" :: held 1.850s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "cinder-932ae6e6-1951-4a16-8d1e-836d6459e949-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-932ae6e6-1951-4a16-8d1e-836d6459e949-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:23 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:56:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "cinder-quobyte-932ae6e6-1951-4a16-8d1e-836d6459e949" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-quobyte-932ae6e6-1951-4a16-8d1e-836d6459e949" acquired by "delete_volume" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:23 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a193966-b6a2-4db4-b671-1261220e48f1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:56:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949" returned: 0 in 0.411s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-932ae6e6-1951-4a16-8d1e-836d6459e949" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:24 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-quobyte-932ae6e6-1951-4a16-8d1e-836d6459e949" released by "delete_volume" :: held 0.662s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:24 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Created reservations ['7826f1db-fbf5-46b8-99a0-3d01d5f60314', 'c4b0bd04-bdf7-4b3f-bc8a-9ca778dd3417', 'f7b7736a-ee23-4fa7-b123-9ac65d42f1db', 'e46c679b-44cb-40df-ac5f-23655c49f89a'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.085s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:56:25 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Deleted volume successfully. Sep 18 11:56:25 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2a7750fd-a659-4590-aecb-50ed2bbbaf9d tempest-VolumeSnapshotQuotasNegativeTestJSON-605085793 None] Lock "cinder-932ae6e6-1951-4a16-8d1e-836d6459e949-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:32 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Flow 'volume_create_manager' (e581cc5f-c2c1-42d1-8e75-44cb275dd3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42bb396-3633-4fd4-be07-d1c64de228b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42bb396-3633-4fd4-be07-d1c64de228b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-757870570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618e4c47-98b1-4385-a003-1d62f7d8b9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c849c448e6e741eb934212f53ea2765f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:56:32Z,use_quota=True,user_id='eb6926a1c15c46ef9ba8c703d170d354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5de136b-502d-4339-9029-c7e27ea2082c),volume_type_id=b5de136b-502d-4339-9029-c7e27ea2082c)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33088d3-929a-47dd-876f-bda01c290446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33088d3-929a-47dd-876f-bda01c290446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6340e6b1-f775-45ec-857a-15c012aff11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6340e6b1-f775-45ec-857a-15c012aff11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618e4c47-98b1-4385-a003-1d62f7d8b9e5', 'volume_name': 'volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9610fc-f14f-45bd-80cd-81da8f53b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9610fc-f14f-45bd-80cd-81da8f53b291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4da8425-9f4b-456d-b282-4e364399e9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:32 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Volume 618e4c47-98b1-4385-a003-1d62f7d8b9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5', 'volume_size': 1} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-757870570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618e4c47-98b1-4385-a003-1d62f7d8b9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c849c448e6e741eb934212f53ea2765f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:56:32Z,use_quota=True,user_id='eb6926a1c15c46ef9ba8c703d170d354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5de136b-502d-4339-9029-c7e27ea2082c),volume_type_id=b5de136b-502d-4339-9029-c7e27ea2082c)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Creating volume 618e4c47-98b1-4385-a003-1d62f7d8b9e5 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:56:32 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:32 devstack quobyte-client[83210]: System call of process 96875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:56:32 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=111, name=volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5 1073741824" returned: 0 in 0.320s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5" returned: 0 in 0.082s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] <== create_volume: return (471ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:56:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.483s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4da8425-9f4b-456d-b282-4e364399e9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb143b7-3780-4225-aba4-c72087416687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:56:33 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Volume volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5 (618e4c47-98b1-4385-a003-1d62f7d8b9e5): created successfully Sep 18 11:56:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb143b7-3780-4225-aba4-c72087416687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:56:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Flow 'volume_create_manager' (e581cc5f-c2c1-42d1-8e75-44cb275dd3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:56:33 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-81d6f739-c610-412d-abba-a3219602fbc5 tempest-VolumeTypesAccessTest-915100143 None] Created volume successfully. Sep 18 11:56:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Acquiring lock "cinder-618e4c47-98b1-4385-a003-1d62f7d8b9e5-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Lock "cinder-618e4c47-98b1-4385-a003-1d62f7d8b9e5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:34 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:56:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Acquiring lock "cinder-quobyte-618e4c47-98b1-4385-a003-1d62f7d8b9e5" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:56:34 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Lock "cinder-quobyte-618e4c47-98b1-4385-a003-1d62f7d8b9e5" acquired by "delete_volume" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:56:34 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b1d745-f8a9-439d-8fe0-4be58d60ef22]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:56:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5" returned: 0 in 0.426s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-618e4c47-98b1-4385-a003-1d62f7d8b9e5" returned: 0 in 0.110s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Lock "cinder-quobyte-618e4c47-98b1-4385-a003-1d62f7d8b9e5" released by "delete_volume" :: held 0.685s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:35 devstack cinder-volume[83184]: WARNING cinder.quota [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1143088855 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1143088855, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:56:35 devstack cinder-volume[83184]: WARNING cinder.quota [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1143088855 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1143088855, it is now deprecated. Please use the default quota class for default quota. Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Created reservations ['f6c3c8ac-908f-428e-9b1c-446a09a2a9a0', '0254fda9-abd2-48b9-81c9-51097a8d7fb9', '984bbf87-c51a-46e3-81bd-8c6b2997aa57', '1c852e87-b06f-47bd-b3f3-23cd8ddd5347'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.108s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:36 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:56:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Deleted volume successfully. Sep 18 11:56:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-37e6da67-89c8-4155-b33b-676044fcf39e tempest-VolumeTypesAccessTest-915100143 None] Lock "cinder-618e4c47-98b1-4385-a003-1d62f7d8b9e5-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.107s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:56:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:56:45 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=32,cinder:SELECT=19,cinder:DELETE=3,cinder:INSERT=6 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:56:46 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=17,cinder:DELETE=2,cinder:UPDATE=21,cinder:INSERT=6 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.089s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:57:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:57:48 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (e4cd036e-3bc1-406c-8c2b-a337f903408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853a2294-fb68-473e-9947-b68c4492c9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853a2294-fb68-473e-9947-b68c4492c9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1985018859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ac43d2-0547-42e2-abc1-8787e52f4020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:57:48Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df2adf3-e40e-4386-a7ae-a3e5d1b662f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df2adf3-e40e-4386-a7ae-a3e5d1b662f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7110e17-8053-461a-935b-7d4bdab55aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7110e17-8053-461a-935b-7d4bdab55aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ac43d2-0547-42e2-abc1-8787e52f4020', 'volume_name': 'volume-69ac43d2-0547-42e2-abc1-8787e52f4020', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2fd0a4-3ea8-48a8-b2c6-a60d6ea102b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2fd0a4-3ea8-48a8-b2c6-a60d6ea102b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f353295-bbc2-48a3-9758-5b3bb4ae0f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:57:48 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Volume 69ac43d2-0547-42e2-abc1-8787e52f4020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ac43d2-0547-42e2-abc1-8787e52f4020', 'volume_size': 1} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1985018859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ac43d2-0547-42e2-abc1-8787e52f4020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:57:48Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Creating volume 69ac43d2-0547-42e2-abc1-8787e52f4020 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:57:48 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:57:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69ac43d2-0547-42e2-abc1-8787e52f4020 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:57:48 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=112, name=volume-69ac43d2-0547-42e2-abc1-8787e52f4020, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69ac43d2-0547-42e2-abc1-8787e52f4020 1073741824" returned: 0 in 0.459s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69ac43d2-0547-42e2-abc1-8787e52f4020 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69ac43d2-0547-42e2-abc1-8787e52f4020" returned: 0 in 0.137s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] <== create_volume: return (661ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f353295-bbc2-48a3-9758-5b3bb4ae0f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ac43d2-0547-42e2-abc1-8787e52f4020', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a132324-e228-4ecb-b789-af2650784e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:57:49 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Volume volume-69ac43d2-0547-42e2-abc1-8787e52f4020 (69ac43d2-0547-42e2-abc1-8787e52f4020): created successfully Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a132324-e228-4ecb-b789-af2650784e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:57:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (e4cd036e-3bc1-406c-8c2b-a337f903408a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:57:49 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-bc8d1478-bc37-45a8-8a9b-7b69c2e667ca tempest-VolumesActionsTest-543231124 None] Created volume successfully. Sep 18 11:57:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-54fe203b-df5c-481c-b039-92f5f73102eb tempest-VolumesActionsTest-543231124 None] Acquiring lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020" by "attach_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:57:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-54fe203b-df5c-481c-b039-92f5f73102eb tempest-VolumesActionsTest-543231124 None] Lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020" acquired by "attach_volume" :: waited 0.055s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:57:50 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-54fe203b-df5c-481c-b039-92f5f73102eb tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:57:50 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-54fe203b-df5c-481c-b039-92f5f73102eb tempest-VolumesActionsTest-543231124 None] Attaching volume 69ac43d2-0547-42e2-abc1-8787e52f4020 to instance 5d7e48c2-cd22-49d3-a5c4-b5b35c3a0bcd at mountpoint /dev/vdb on host None. Sep 18 11:57:50 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-54fe203b-df5c-481c-b039-92f5f73102eb tempest-VolumesActionsTest-543231124 None] Attach volume completed successfully. Sep 18 11:57:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-54fe203b-df5c-481c-b039-92f5f73102eb tempest-VolumesActionsTest-543231124 None] Lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020" released by "attach_volume" :: held 0.319s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:57:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:57:51 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Terminate volume connection completed successfully. Sep 18 11:57:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-detach_volume" by "detach_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:57:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:57:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:57:51 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Detaching volume 69ac43d2-0547-42e2-abc1-8787e52f4020 from instance 5d7e48c2-cd22-49d3-a5c4-b5b35c3a0bcd. Sep 18 11:57:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:57:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Detach volume completed successfully. Sep 18 11:57:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7461c4f9-0cdd-41fa-a89e-fdf8d079b82c tempest-VolumesActionsTest-1027190388 None] Lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:57:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e120e630-4abf-47b9-a79b-19b936cdaeda tempest-VolumesActionsTest-543231124 None] Acquiring lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-detach_volume" by "detach_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:57:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e120e630-4abf-47b9-a79b-19b936cdaeda tempest-VolumesActionsTest-543231124 None] Lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:57:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e120e630-4abf-47b9-a79b-19b936cdaeda tempest-VolumesActionsTest-543231124 None] Volume detach called, but volume not attached. Sep 18 11:57:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e120e630-4abf-47b9-a79b-19b936cdaeda tempest-VolumesActionsTest-543231124 None] Lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:57:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Acquiring lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:57:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:57:53 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:57:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Acquiring lock "cinder-quobyte-69ac43d2-0547-42e2-abc1-8787e52f4020" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:57:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Lock "cinder-quobyte-69ac43d2-0547-42e2-abc1-8787e52f4020" acquired by "delete_volume" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:57:53 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[595f937c-d1d0-493d-b7e5-fd5b53292358]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:57:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69ac43d2-0547-42e2-abc1-8787e52f4020 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:57:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69ac43d2-0547-42e2-abc1-8787e52f4020" returned: 0 in 0.424s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:57:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69ac43d2-0547-42e2-abc1-8787e52f4020 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-69ac43d2-0547-42e2-abc1-8787e52f4020" returned: 0 in 0.115s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Lock "cinder-quobyte-69ac43d2-0547-42e2-abc1-8787e52f4020" released by "delete_volume" :: held 0.698s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Created reservations ['a49e6c32-2806-41cf-af41-90448405f165', '82e35d05-49f9-48b3-b469-5e0b91e4844e', 'a56f7a56-bb7c-4a96-b213-12893699fffd', 'e56a0a6e-3c15-473d-ba6f-a60b56da296c'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.193s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:57:54 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:57:55 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Deleted volume successfully. Sep 18 11:57:55 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-50e67247-adec-4a4b-8b38-523e09d213ad tempest-VolumesActionsTest-543231124 None] Lock "cinder-69ac43d2-0547-42e2-abc1-8787e52f4020-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:04 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (d3dc9817-3240-4909-a6d3-f6086b0c52ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4af293d-96d5-4f0e-9928-2528cfec93fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4af293d-96d5-4f0e-9928-2528cfec93fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-357472413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0fda310-61a0-49d6-b297-48dc06997565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:04Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c9b081-e2b8-498b-94c8-4f1e7ee42f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c9b081-e2b8-498b-94c8-4f1e7ee42f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19115ec4-3074-43c8-816c-9ceb084616b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19115ec4-3074-43c8-816c-9ceb084616b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0fda310-61a0-49d6-b297-48dc06997565', 'volume_name': 'volume-c0fda310-61a0-49d6-b297-48dc06997565', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6173ee3a-8338-4642-b87f-c5e955049a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6173ee3a-8338-4642-b87f-c5e955049a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba626494-6e85-414b-80fa-e5a8e09b94a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:04 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Volume c0fda310-61a0-49d6-b297-48dc06997565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0fda310-61a0-49d6-b297-48dc06997565', 'volume_size': 1} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-357472413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0fda310-61a0-49d6-b297-48dc06997565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:04Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Creating volume c0fda310-61a0-49d6-b297-48dc06997565 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:04 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0fda310-61a0-49d6-b297-48dc06997565 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:04 devstack quobyte-client[83210]: System call of process 97126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:04 devstack quobyte-client[83210]: System call of process 97126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:04 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=113, name=volume-c0fda310-61a0-49d6-b297-48dc06997565, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0fda310-61a0-49d6-b297-48dc06997565 1073741824" returned: 0 in 0.323s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0fda310-61a0-49d6-b297-48dc06997565 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0fda310-61a0-49d6-b297-48dc06997565" returned: 0 in 0.087s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] <== create_volume: return (477ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba626494-6e85-414b-80fa-e5a8e09b94a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0fda310-61a0-49d6-b297-48dc06997565', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a34c32-74ee-4163-9a0e-f0b405647a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:05 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Volume volume-c0fda310-61a0-49d6-b297-48dc06997565 (c0fda310-61a0-49d6-b297-48dc06997565): created successfully Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a34c32-74ee-4163-9a0e-f0b405647a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (d3dc9817-3240-4909-a6d3-f6086b0c52ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d972dc66-9924-4264-8d07-cedbe88a9f00 tempest-VolumesActionsTest-543231124 None] Created volume successfully. Sep 18 11:58:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-c0fda310-61a0-49d6-b297-48dc06997565-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Lock "cinder-c0fda310-61a0-49d6-b297-48dc06997565-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:06 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-quobyte-c0fda310-61a0-49d6-b297-48dc06997565" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Lock "cinder-quobyte-c0fda310-61a0-49d6-b297-48dc06997565" acquired by "delete_volume" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:07 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33be882c-2714-48f0-9d76-af976de44934]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0fda310-61a0-49d6-b297-48dc06997565 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0fda310-61a0-49d6-b297-48dc06997565" returned: 0 in 0.415s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0fda310-61a0-49d6-b297-48dc06997565 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c0fda310-61a0-49d6-b297-48dc06997565" returned: 0 in 0.110s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Lock "cinder-quobyte-c0fda310-61a0-49d6-b297-48dc06997565" released by "delete_volume" :: held 0.664s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:07 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Created reservations ['354dfab1-0c31-4403-8d46-5b0c8526894d', '440e297a-7235-46a4-8073-ce0b7daac95e', 'f6db470e-d372-4097-8442-3f4f44ba9333', '3fa2ce60-7bb4-48fd-912e-b088725ff70c'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.106s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:08 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Deleted volume successfully. Sep 18 11:58:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2da147c5-1780-46f7-acd6-be8b320beadd tempest-VolumesActionsTest-1027190388 None] Lock "cinder-c0fda310-61a0-49d6-b297-48dc06997565-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:09 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (4013ebde-fc72-4b27-9517-c27c4d7e881b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a72b58-abcd-4814-9ac0-31f07c700f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a72b58-abcd-4814-9ac0-31f07c700f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481661002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c8ed20-e924-4fd7-922d-e0e252c6b7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:10Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97e7fc0-a6ae-48da-b86c-0f3da6cd3bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97e7fc0-a6ae-48da-b86c-0f3da6cd3bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32989934-4424-4514-a8fc-8162fa1b4079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32989934-4424-4514-a8fc-8162fa1b4079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c8ed20-e924-4fd7-922d-e0e252c6b7a6', 'volume_name': 'volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5135a89-c77c-498d-91a6-d1a0c78e9ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5135a89-c77c-498d-91a6-d1a0c78e9ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6680c153-ecd2-4af6-b026-c93771959457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:09 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Volume 93c8ed20-e924-4fd7-922d-e0e252c6b7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6', 'volume_size': 1} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481661002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c8ed20-e924-4fd7-922d-e0e252c6b7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:10Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Creating volume 93c8ed20-e924-4fd7-922d-e0e252c6b7a6 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:09 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:10 devstack quobyte-client[83210]: System call of process 97139 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:10 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=114, name=volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6 1073741824" returned: 0 in 0.361s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6" returned: 0 in 0.122s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] <== create_volume: return (620ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6680c153-ecd2-4af6-b026-c93771959457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d7edd7-2092-41bf-8378-f0a05951b2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:10 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Volume volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6 (93c8ed20-e924-4fd7-922d-e0e252c6b7a6): created successfully Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d7edd7-2092-41bf-8378-f0a05951b2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:10 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (4013ebde-fc72-4b27-9517-c27c4d7e881b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:10 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-c86f0592-75d9-4d37-92d9-fe34c4920b55 tempest-VolumesActionsTest-543231124 None] Created volume successfully. Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-93c8ed20-e924-4fd7-922d-e0e252c6b7a6-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Lock "cinder-93c8ed20-e924-4fd7-922d-e0e252c6b7a6-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:12 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-quobyte-93c8ed20-e924-4fd7-922d-e0e252c6b7a6" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Lock "cinder-quobyte-93c8ed20-e924-4fd7-922d-e0e252c6b7a6" acquired by "delete_volume" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa82a6-1afa-48f2-9551-590a3c04f32f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6" returned: 0 in 0.470s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-93c8ed20-e924-4fd7-922d-e0e252c6b7a6" returned: 0 in 0.144s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Lock "cinder-quobyte-93c8ed20-e924-4fd7-922d-e0e252c6b7a6" released by "delete_volume" :: held 0.733s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Created reservations ['e326b3e2-d46b-48f6-9f42-d5b83b3bbf6b', '08f336a5-a89a-4f2c-8d14-aed8d3a7931d', '693254b9-297c-40ed-86ef-4af47e2afd5f', 'e12cc287-e3d9-4d59-b252-7d8eb069bad2'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.100s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:13 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Deleted volume successfully. Sep 18 11:58:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-aa06f010-ecc8-4365-a9f2-ac11bfdca62f tempest-VolumesActionsTest-1027190388 None] Lock "cinder-93c8ed20-e924-4fd7-922d-e0e252c6b7a6-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:14 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (212ebe3d-4ddf-4adf-84cb-3312249e1e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b625a45-0596-46af-88e1-81fe2c6dc5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b625a45-0596-46af-88e1-81fe2c6dc5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-174450855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d474f0-8dba-48fd-8125-2d6ac432a45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:15Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874ff2bf-cc52-405b-9c5b-5e42d3525416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874ff2bf-cc52-405b-9c5b-5e42d3525416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff41b46-884f-489c-93af-b592df66be3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff41b46-884f-489c-93af-b592df66be3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d474f0-8dba-48fd-8125-2d6ac432a45b', 'volume_name': 'volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5ae30a-6bb4-4626-87bb-ccb22962d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5ae30a-6bb4-4626-87bb-ccb22962d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf45236-4dfa-4576-a82a-597e17b44158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:14 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Volume b9d474f0-8dba-48fd-8125-2d6ac432a45b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b', 'volume_size': 1} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-174450855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d474f0-8dba-48fd-8125-2d6ac432a45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:15Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Creating volume b9d474f0-8dba-48fd-8125-2d6ac432a45b {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:15 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:15 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=115, name=volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b 1073741824" returned: 0 in 0.369s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b" returned: 0 in 0.082s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] <== create_volume: return (509ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.520s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf45236-4dfa-4576-a82a-597e17b44158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b6fed2-7a13-4ece-b518-11b976dabda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:15 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Volume volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b (b9d474f0-8dba-48fd-8125-2d6ac432a45b): created successfully Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b6fed2-7a13-4ece-b518-11b976dabda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:15 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (212ebe3d-4ddf-4adf-84cb-3312249e1e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e402b8da-508d-4271-8bd0-57e4ccebfb5d tempest-VolumesActionsTest-543231124 None] Created volume successfully. Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-b9d474f0-8dba-48fd-8125-2d6ac432a45b-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Lock "cinder-b9d474f0-8dba-48fd-8125-2d6ac432a45b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:17 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-quobyte-b9d474f0-8dba-48fd-8125-2d6ac432a45b" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Lock "cinder-quobyte-b9d474f0-8dba-48fd-8125-2d6ac432a45b" acquired by "delete_volume" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e3d094-c9b6-4659-b567-1287ae20162a]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b" returned: 0 in 0.402s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b9d474f0-8dba-48fd-8125-2d6ac432a45b" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Lock "cinder-quobyte-b9d474f0-8dba-48fd-8125-2d6ac432a45b" released by "delete_volume" :: held 0.652s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Created reservations ['d10d0268-e730-4076-aca8-9949977e024d', '7bca90fc-eb08-4bac-a418-7cbd1a5cb00d', '9de11c8d-c8c2-4a61-ac2b-063c70bc4f22', '0bf06434-4ecd-4ead-b24c-146f3308eb1b'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:18 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Deleted volume successfully. Sep 18 11:58:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1cbdec36-8b71-4a37-aef3-d2b23243fab7 tempest-VolumesActionsTest-1027190388 None] Lock "cinder-b9d474f0-8dba-48fd-8125-2d6ac432a45b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:19 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (21ee224e-62f0-439c-b0c7-a532a693956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dba3a42-fa82-4bb7-912e-7cd25a21cf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dba3a42-fa82-4bb7-912e-7cd25a21cf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1154696255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194b01ad-6d99-4308-af08-eddf4b605cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:20Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d43b7ce-1cb6-48f9-a807-0b6aa0e58ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d43b7ce-1cb6-48f9-a807-0b6aa0e58ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d85039-80f9-4d9c-b835-297547237f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d85039-80f9-4d9c-b835-297547237f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194b01ad-6d99-4308-af08-eddf4b605cea', 'volume_name': 'volume-194b01ad-6d99-4308-af08-eddf4b605cea', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1211b4-da3e-412d-b583-9686ec0facb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1211b4-da3e-412d-b583-9686ec0facb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc2dc56-1095-4ba4-9903-1f8cc50cc61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:20 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Volume 194b01ad-6d99-4308-af08-eddf4b605cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194b01ad-6d99-4308-af08-eddf4b605cea', 'volume_size': 1} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1154696255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194b01ad-6d99-4308-af08-eddf4b605cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:20Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Creating volume 194b01ad-6d99-4308-af08-eddf4b605cea {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:20 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-194b01ad-6d99-4308-af08-eddf4b605cea 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:20 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=116, name=volume-194b01ad-6d99-4308-af08-eddf4b605cea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-194b01ad-6d99-4308-af08-eddf4b605cea 1073741824" returned: 0 in 0.331s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-194b01ad-6d99-4308-af08-eddf4b605cea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-194b01ad-6d99-4308-af08-eddf4b605cea" returned: 0 in 0.089s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] <== create_volume: return (491ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc2dc56-1095-4ba4-9903-1f8cc50cc61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194b01ad-6d99-4308-af08-eddf4b605cea', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360b3d4a-b501-4adc-98f0-223df5fc093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:20 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Volume volume-194b01ad-6d99-4308-af08-eddf4b605cea (194b01ad-6d99-4308-af08-eddf4b605cea): created successfully Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360b3d4a-b501-4adc-98f0-223df5fc093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:20 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (21ee224e-62f0-439c-b0c7-a532a693956a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:20 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-c3d3ba56-9b6f-4bf8-9d00-f754f0384e10 tempest-VolumesActionsTest-543231124 None] Created volume successfully. Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-194b01ad-6d99-4308-af08-eddf4b605cea-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Lock "cinder-194b01ad-6d99-4308-af08-eddf4b605cea-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:22 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Acquiring lock "cinder-quobyte-194b01ad-6d99-4308-af08-eddf4b605cea" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Lock "cinder-quobyte-194b01ad-6d99-4308-af08-eddf4b605cea" acquired by "delete_volume" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7961a6d-401c-4298-9bd8-f5af68aa4d8c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-194b01ad-6d99-4308-af08-eddf4b605cea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-194b01ad-6d99-4308-af08-eddf4b605cea" returned: 0 in 0.399s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-194b01ad-6d99-4308-af08-eddf4b605cea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-194b01ad-6d99-4308-af08-eddf4b605cea" returned: 0 in 0.107s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Lock "cinder-quobyte-194b01ad-6d99-4308-af08-eddf4b605cea" released by "delete_volume" :: held 0.652s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Created reservations ['4de2b748-ef8d-47f5-9ccb-97ede54afd42', 'a19773b3-3a91-4dfd-ba2f-40979176c367', 'cf805d02-ba9c-4dea-9a4e-7ae8b3565dd8', '2ddd8520-02c7-4389-a1d7-59596b9ea8ba'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.099s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:23 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Deleted volume successfully. Sep 18 11:58:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-8b686bca-83db-4646-ac6a-ea69ee52946e tempest-VolumesActionsTest-1027190388 None] Lock "cinder-194b01ad-6d99-4308-af08-eddf4b605cea-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:24 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:24 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (1bb25a5a-b2fe-46a3-af95-bba3b18683d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c386c0-48fa-4261-858c-2a674923b465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c386c0-48fa-4261-858c-2a674923b465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1789824560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690830a9-1d57-4139-aa10-c17b550f8058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:25Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad2ef04-bc8e-4ed6-99a9-a9ecff36359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad2ef04-bc8e-4ed6-99a9-a9ecff36359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f67882-635a-45a7-bbcf-400efaa781a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f67882-635a-45a7-bbcf-400efaa781a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '690830a9-1d57-4139-aa10-c17b550f8058', 'volume_name': 'volume-690830a9-1d57-4139-aa10-c17b550f8058', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d093966-3f94-4e5a-b742-9b510e680695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d093966-3f94-4e5a-b742-9b510e680695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ef437d-af78-4e0c-910b-deb68fd19b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:25 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Volume 690830a9-1d57-4139-aa10-c17b550f8058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-690830a9-1d57-4139-aa10-c17b550f8058', 'volume_size': 1} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1789824560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690830a9-1d57-4139-aa10-c17b550f8058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b44ff6bb8cc482ba71b965d462507c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:25Z,use_quota=True,user_id='3f3307b869964762ba68a3d940f3db75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Creating volume 690830a9-1d57-4139-aa10-c17b550f8058 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:25 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-690830a9-1d57-4139-aa10-c17b550f8058 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:25 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=117, name=volume-690830a9-1d57-4139-aa10-c17b550f8058, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:25 devstack quobyte-client[83210]: System call of process 97167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-690830a9-1d57-4139-aa10-c17b550f8058 1073741824" returned: 0 in 0.330s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-690830a9-1d57-4139-aa10-c17b550f8058 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-690830a9-1d57-4139-aa10-c17b550f8058" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ef437d-af78-4e0c-910b-deb68fd19b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690830a9-1d57-4139-aa10-c17b550f8058', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096a3703-7be3-452e-9638-65ee9cb3d02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:25 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Volume volume-690830a9-1d57-4139-aa10-c17b550f8058 (690830a9-1d57-4139-aa10-c17b550f8058): created successfully Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096a3703-7be3-452e-9638-65ee9cb3d02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Flow 'volume_create_manager' (1bb25a5a-b2fe-46a3-af95-bba3b18683d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:25 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-53b1f77e-b3d3-4486-999e-cd5283940d8b tempest-VolumesActionsTest-543231124 None] Created volume successfully. Sep 18 11:58:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Acquiring lock "cinder-690830a9-1d57-4139-aa10-c17b550f8058-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Lock "cinder-690830a9-1d57-4139-aa10-c17b550f8058-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Acquiring lock "cinder-quobyte-690830a9-1d57-4139-aa10-c17b550f8058" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Lock "cinder-quobyte-690830a9-1d57-4139-aa10-c17b550f8058" acquired by "delete_volume" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:27 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c05194-6b39-4037-8a93-9e49d125a7c9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-690830a9-1d57-4139-aa10-c17b550f8058 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-690830a9-1d57-4139-aa10-c17b550f8058" returned: 0 in 0.454s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-690830a9-1d57-4139-aa10-c17b550f8058 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-690830a9-1d57-4139-aa10-c17b550f8058" returned: 0 in 0.100s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Lock "cinder-quobyte-690830a9-1d57-4139-aa10-c17b550f8058" released by "delete_volume" :: held 0.688s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Created reservations ['dfd980da-f0e3-4543-b25b-b790ba7f916f', '0ca62aa2-831e-4387-8da9-165960e1a868', '744fec46-e6a7-4ffe-b009-807468c1e2ec', 'de7cfb0f-b1c5-4c71-aaf4-21caed941898'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.096s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:29 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:29 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Deleted volume successfully. Sep 18 11:58:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-05561b37-d862-4734-9d11-f7c3117db838 tempest-VolumesActionsTest-543231124 None] Lock "cinder-690830a9-1d57-4139-aa10-c17b550f8058-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:38 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=69,cinder:SELECT=41,cinder:DELETE=4,cinder:INSERT=14 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:58:39 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=47,cinder:UPDATE=59,cinder:INSERT=12,cinder:DELETE=8 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:58:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Flow 'volume_create_manager' (bb8cb5bb-9470-4512-80bd-b8ec30c0ded7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a6d683-c2a0-49d3-a84f-2d69fe7e2c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a6d683-c2a0-49d3-a84f-2d69fe7e2c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-724283116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351e8a8b-65ee-4472-b608-399fa3621f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c69cbb14414e759832ac2f4809ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:44Z,use_quota=True,user_id='32615199ebdc4e058b510d2c89c7c5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67f58bf-632f-483e-89b6-79aca5beb174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67f58bf-632f-483e-89b6-79aca5beb174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d47a88-7964-44fe-91e2-0bf5ce0da8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d47a88-7964-44fe-91e2-0bf5ce0da8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351e8a8b-65ee-4472-b608-399fa3621f0b', 'volume_name': 'volume-351e8a8b-65ee-4472-b608-399fa3621f0b', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705575f0-1030-4471-944c-4c46e84ccbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705575f0-1030-4471-944c-4c46e84ccbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7466c0-57d1-481f-b738-e8fabe000c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:43 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Volume 351e8a8b-65ee-4472-b608-399fa3621f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351e8a8b-65ee-4472-b608-399fa3621f0b', 'volume_size': 1} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-724283116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351e8a8b-65ee-4472-b608-399fa3621f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c69cbb14414e759832ac2f4809ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:44Z,use_quota=True,user_id='32615199ebdc4e058b510d2c89c7c5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Creating volume 351e8a8b-65ee-4472-b608-399fa3621f0b {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:43 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-351e8a8b-65ee-4472-b608-399fa3621f0b 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:44 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=118, name=volume-351e8a8b-65ee-4472-b608-399fa3621f0b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-351e8a8b-65ee-4472-b608-399fa3621f0b 1073741824" returned: 0 in 0.309s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-351e8a8b-65ee-4472-b608-399fa3621f0b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-351e8a8b-65ee-4472-b608-399fa3621f0b" returned: 0 in 0.083s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] <== create_volume: return (550ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.595s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.281s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7466c0-57d1-481f-b738-e8fabe000c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351e8a8b-65ee-4472-b608-399fa3621f0b', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce1f889-e889-4a83-9c48-e9dffa85c324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:44 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Volume volume-351e8a8b-65ee-4472-b608-399fa3621f0b (351e8a8b-65ee-4472-b608-399fa3621f0b): created successfully Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce1f889-e889-4a83-9c48-e9dffa85c324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Flow 'volume_create_manager' (bb8cb5bb-9470-4512-80bd-b8ec30c0ded7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:44 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-11072758-992a-449b-88dc-24c2aa30fcc4 tempest-VolumesListAdminTestJSON-2038480587 None] Created volume successfully. Sep 18 11:58:46 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Flow 'volume_create_manager' (e741e644-3084-412e-a6b4-d83c382b33ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225710f3-b3e3-45ec-b31b-1d287c1a27d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225710f3-b3e3-45ec-b31b-1d287c1a27d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-184797513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c69cbb14414e759832ac2f4809ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:46Z,use_quota=True,user_id='32615199ebdc4e058b510d2c89c7c5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c59b78-6f74-4b43-a002-4aa0904139a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c59b78-6f74-4b43-a002-4aa0904139a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18288055-78ec-41a9-8b68-a4e5c041223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18288055-78ec-41a9-8b68-a4e5c041223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf', 'volume_name': 'volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4363674-46ec-45a0-a548-78ea3c93ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4363674-46ec-45a0-a548-78ea3c93ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce3e824-5e54-4cbf-9157-e78e68712ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:46 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Volume 1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf', 'volume_size': 1} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-184797513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c69cbb14414e759832ac2f4809ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:46Z,use_quota=True,user_id='32615199ebdc4e058b510d2c89c7c5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Creating volume 1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:46 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:46 devstack quobyte-client[83210]: System call of process 97220 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:46 devstack quobyte-client[83210]: System call of process 97220 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:46 devstack quobyte-client[83210]: System call of process 97220 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:46 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=119, name=volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf 1073741824" returned: 0 in 0.297s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf" returned: 0 in 0.081s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] <== create_volume: return (434ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.445s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce3e824-5e54-4cbf-9157-e78e68712ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08df7d34-3d35-46b8-a62f-077ea8fb0935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:47 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Volume volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf (1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf): created successfully Sep 18 11:58:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08df7d34-3d35-46b8-a62f-077ea8fb0935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Flow 'volume_create_manager' (e741e644-3084-412e-a6b4-d83c382b33ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:47 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b8bc07df-13f0-4dc4-8fc8-496f116372e9 tempest-VolumesListAdminTestJSON-2038480587 None] Created volume successfully. Sep 18 11:58:48 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Flow 'volume_create_manager' (8f7f8774-a595-4d9f-b405-4ed6a08d47ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7b241b-dd99-4646-b54e-9faaaa567eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7b241b-dd99-4646-b54e-9faaaa567eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-918603046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e05c82-8bfa-47ee-ab48-d96964f7ce02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c69cbb14414e759832ac2f4809ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:49Z,use_quota=True,user_id='32615199ebdc4e058b510d2c89c7c5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7612f5b-ea05-4a60-924d-fe7bc963ea9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7612f5b-ea05-4a60-924d-fe7bc963ea9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9aa491-9509-4c4c-a24a-82b0dcfce4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a9aa491-9509-4c4c-a24a-82b0dcfce4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e05c82-8bfa-47ee-ab48-d96964f7ce02', 'volume_name': 'volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced42209-bea8-4a9d-a4ad-7bc7669da8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced42209-bea8-4a9d-a4ad-7bc7669da8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77c4b6a-1981-4192-b099-2e206e80f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:48 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Volume 10e05c82-8bfa-47ee-ab48-d96964f7ce02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02', 'volume_size': 1} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-918603046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e05c82-8bfa-47ee-ab48-d96964f7ce02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91c69cbb14414e759832ac2f4809ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:49Z,use_quota=True,user_id='32615199ebdc4e058b510d2c89c7c5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Creating volume 10e05c82-8bfa-47ee-ab48-d96964f7ce02 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:48 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:49 devstack quobyte-client[83210]: System call of process 97225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:49 devstack quobyte-client[83210]: System call of process 97225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:49 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=120, name=volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02 1073741824" returned: 0 in 0.325s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02" returned: 0 in 0.083s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] <== create_volume: return (467ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.477s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77c4b6a-1981-4192-b099-2e206e80f831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156faa18-da76-4cf0-84a8-c42040505f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:49 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Volume volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02 (10e05c82-8bfa-47ee-ab48-d96964f7ce02): created successfully Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156faa18-da76-4cf0-84a8-c42040505f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Flow 'volume_create_manager' (8f7f8774-a595-4d9f-b405-4ed6a08d47ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:49 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-947a6416-c3d6-4880-aae6-64bbba3b0d85 tempest-VolumesListAdminTestJSON-2038480587 None] Created volume successfully. Sep 18 11:58:50 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Flow 'volume_create_manager' (51559af6-f538-4fe5-8885-519a26f342a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26fb3ff-ec9c-4603-92e4-4db5d5dc8184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26fb3ff-ec9c-4603-92e4-4db5d5dc8184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb10d635-7e91-4370-aed2-a50e4191a14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a6be9b4c9b4d2e8e315e17e265533e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:50Z,use_quota=True,user_id='c0e8c0145f854143837724c0140d8517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2467c05-fdc9-4fb2-9722-841742fab82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2467c05-fdc9-4fb2-9722-841742fab82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7e2660-b89e-48a1-a3a0-09bd735d2be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7e2660-b89e-48a1-a3a0-09bd735d2be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb10d635-7e91-4370-aed2-a50e4191a14e', 'volume_name': 'volume-cb10d635-7e91-4370-aed2-a50e4191a14e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e756136-e5d8-4eef-8c74-c8b47bd8a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e756136-e5d8-4eef-8c74-c8b47bd8a86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144f716b-79d6-4bec-8dc8-189e6f4973f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:50 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Volume cb10d635-7e91-4370-aed2-a50e4191a14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb10d635-7e91-4370-aed2-a50e4191a14e', 'volume_size': 1} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb10d635-7e91-4370-aed2-a50e4191a14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a6be9b4c9b4d2e8e315e17e265533e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:58:50Z,use_quota=True,user_id='c0e8c0145f854143837724c0140d8517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Creating volume cb10d635-7e91-4370-aed2-a50e4191a14e {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:58:50 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb10d635-7e91-4370-aed2-a50e4191a14e 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:50 devstack quobyte-client[83210]: System call of process 97229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:50 devstack quobyte-client[83210]: System call of process 97229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:50 devstack quobyte-client[83210]: System call of process 97229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:58:50 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=121, name=volume-cb10d635-7e91-4370-aed2-a50e4191a14e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb10d635-7e91-4370-aed2-a50e4191a14e 1073741824" returned: 0 in 0.329s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb10d635-7e91-4370-aed2-a50e4191a14e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb10d635-7e91-4370-aed2-a50e4191a14e" returned: 0 in 0.087s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] <== create_volume: return (482ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144f716b-79d6-4bec-8dc8-189e6f4973f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb10d635-7e91-4370-aed2-a50e4191a14e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c2c175-1d42-415b-8191-2c4f88b24285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:58:51 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Volume volume-cb10d635-7e91-4370-aed2-a50e4191a14e (cb10d635-7e91-4370-aed2-a50e4191a14e): created successfully Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c2c175-1d42-415b-8191-2c4f88b24285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Flow 'volume_create_manager' (51559af6-f538-4fe5-8885-519a26f342a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:58:51 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4fcff2fb-561d-4011-9d22-4acde7a00378 tempest-VolumesListAdminTestJSON-89672692 None] Created volume successfully. Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Acquiring lock "cinder-cb10d635-7e91-4370-aed2-a50e4191a14e-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Lock "cinder-cb10d635-7e91-4370-aed2-a50e4191a14e-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "cinder-10e05c82-8bfa-47ee-ab48-d96964f7ce02-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-10e05c82-8bfa-47ee-ab48-d96964f7ce02-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Acquiring lock "cinder-quobyte-cb10d635-7e91-4370-aed2-a50e4191a14e" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Lock "cinder-quobyte-cb10d635-7e91-4370-aed2-a50e4191a14e" acquired by "delete_volume" :: waited 0.017s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d238b453-323f-4349-865c-fe9818235dd7]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb10d635-7e91-4370-aed2-a50e4191a14e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "cinder-quobyte-10e05c82-8bfa-47ee-ab48-d96964f7ce02" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-quobyte-10e05c82-8bfa-47ee-ab48-d96964f7ce02" acquired by "delete_volume" :: waited 0.100s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c3c2a8-9cda-405b-9e11-e553dff9bc65]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb10d635-7e91-4370-aed2-a50e4191a14e" returned: 0 in 0.583s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb10d635-7e91-4370-aed2-a50e4191a14e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cb10d635-7e91-4370-aed2-a50e4191a14e" returned: 0 in 0.107s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Lock "cinder-quobyte-cb10d635-7e91-4370-aed2-a50e4191a14e" released by "delete_volume" :: held 0.904s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02" returned: 0 in 0.688s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-10e05c82-8bfa-47ee-ab48-d96964f7ce02" returned: 0 in 0.293s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-quobyte-10e05c82-8bfa-47ee-ab48-d96964f7ce02" released by "delete_volume" :: held 1.094s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Created reservations ['63815ed5-998a-4acc-b3a9-0594a6c70971', '7ae11c81-8388-4603-a55c-79ee3b282b12', '1d0bec40-86ed-4df3-bf96-768f3ccd0e50', 'a5627da1-4478-4c6c-bb5b-d7438c7e94e6'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Created reservations ['1b55c250-220e-4128-a373-b1bf4f965098', 'aaffc287-efc7-4953-aaa0-7946b9a683ec', 'a3642687-7457-43c1-89b7-949cb1b34403', '2b053050-349d-45a3-9fe8-f16e531ea4f0'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.254s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:53 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:54 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Deleted volume successfully. Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ed89dc52-0160-4f1d-89a8-f22ebc2ae56e tempest-VolumesListAdminTestJSON-89672692 None] Lock "cinder-cb10d635-7e91-4370-aed2-a50e4191a14e-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.241s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:54 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Deleted volume successfully. Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "cinder-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ecd14ec5-fb05-4dea-8e3a-5fe8cb8b14d5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-10e05c82-8bfa-47ee-ab48-d96964f7ce02-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:54 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "cinder-quobyte-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-quobyte-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf" acquired by "delete_volume" :: waited 0.023s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9a43d-193d-4616-9170-0cade1af68f1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf" returned: 0 in 0.396s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf" returned: 0 in 0.116s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-quobyte-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf" released by "delete_volume" :: held 0.657s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Created reservations ['708fb02e-64b5-4c3e-8226-9202daf8e3cf', '6fc9386a-01b0-4b88-a577-a9beabff99a1', 'ee45582e-152e-48be-86bd-1a9792100c0c', 'd331f768-2e0c-44a7-82f9-c336d0500439'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.118s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:55 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Deleted volume successfully. Sep 18 11:58:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2846ed06-f4ca-42cf-ac0d-0ccd8e06e379 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-1bb91d6c-0cac-4c36-80d7-e34b9fbf26cf-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "cinder-351e8a8b-65ee-4472-b608-399fa3621f0b-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-351e8a8b-65ee-4472-b608-399fa3621f0b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:58:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "cinder-quobyte-351e8a8b-65ee-4472-b608-399fa3621f0b" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:58:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-quobyte-351e8a8b-65ee-4472-b608-399fa3621f0b" acquired by "delete_volume" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:58:57 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ca625-fcb1-4918-a7c7-cfe14ce95f62]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:58:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-351e8a8b-65ee-4472-b608-399fa3621f0b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-351e8a8b-65ee-4472-b608-399fa3621f0b" returned: 0 in 0.413s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-351e8a8b-65ee-4472-b608-399fa3621f0b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-351e8a8b-65ee-4472-b608-399fa3621f0b" returned: 0 in 0.106s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-quobyte-351e8a8b-65ee-4472-b608-399fa3621f0b" released by "delete_volume" :: held 0.661s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:58:57 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Created reservations ['07d76ec4-a367-4111-bda7-b7676173462a', '1fc88473-531c-40e9-a8d5-1110673eb8a0', 'a98a0e10-e1bf-408f-b038-f5de25d042e2', 'f60aa65d-d31a-48e8-a34a-832f1b192b87'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.085s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:58:58 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Deleted volume successfully. Sep 18 11:58:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-02c237f7-5fae-4950-84d5-25e9b32d3ff5 tempest-VolumesListAdminTestJSON-2038480587 None] Lock "cinder-351e8a8b-65ee-4472-b608-399fa3621f0b-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:03 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:03 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:59:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Flow 'volume_create_manager' (eb36b81c-914a-4027-ac93-2dd6beb09378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6a1f3d-32a9-4a3e-afe7-4189905a7644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6a1f3d-32a9-4a3e-afe7-4189905a7644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1315256340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c28f27f-e1ee-48c4-a746-e2bf6062aeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a377bad47d934a2c9cba9e2227590b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:04Z,use_quota=True,user_id='cd490ee4fa01402fba3aef94acc8313b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36267758-1ed3-41e9-9b8f-0f59bde885f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36267758-1ed3-41e9-9b8f-0f59bde885f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69896c6b-c827-4782-ae36-4e2dc74ef00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:03 devstack cinder-volume[83184]: DEBUG cinder.image.glance [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Creating Keystone auth plugin from conf {{(pid=83184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 18 11:59:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69896c6b-c827-4782-ae36-4e2dc74ef00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c28f27f-e1ee-48c4-a746-e2bf6062aeab', 'volume_name': 'volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c421286-c910-4aa2-9d81-30a42126a50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c421286-c910-4aa2-9d81-30a42126a50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02911d5b-1ac7-4b35-a463-5887a9a61fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:04 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Volume 8c28f27f-e1ee-48c4-a746-e2bf6062aeab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 11:59:04 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Cloning 8c28f27f-e1ee-48c4-a746-e2bf6062aeab from image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]). {{(pid=83184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 18 11:59:04 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 18 11:59:04 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Image download 20.69 MB at 20.69 MB/s Sep 18 11:59:04 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a617d9-b342-4df0-8c1f-663ec5701daa]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:05 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD Sep 18 11:59:05 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:59:06 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 18 11:59:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD" returned: 0 in 1.996s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:06 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Temporary image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 is fetched for user cd490ee4fa01402fba3aef94acc8313b. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 18 11:59:06 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[016eff10-8b58-485a-84fc-7716c81fb55b]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:07 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD Sep 18 11:59:07 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 11:59:09 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD" returned: 0 in 2.284s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1315256340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c28f27f-e1ee-48c4-a746-e2bf6062aeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a377bad47d934a2c9cba9e2227590b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:04Z,use_quota=True,user_id='cd490ee4fa01402fba3aef94acc8313b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Creating volume 8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:59:09 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:09 devstack quobyte-client[83210]: System call of process 97274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:59:09 devstack quobyte-client[83210]: System call of process 97274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:59:09 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=122, name=volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab 1073741824" returned: 0 in 0.316s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" returned: 0 in 0.091s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] <== create_volume: return (523ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:59:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.566s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:10 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Attempting download of 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}])) to volume 8c28f27f-e1ee-48c4-a746-e2bf6062aeab. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 18 11:59:10 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372e844-4a32-4641-a7f7-d25cf202e637]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_n_qjhzhk {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_n_qjhzhk" returned: 0 in 0.459s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_n_qjhzhk {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_n_qjhzhk" returned: 1 in 0.382s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_n_qjhzhk' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:59:11 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d425a6-5436-4ef2-b6a6-f7ce23b125a5]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:11 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 was qcow2, converting to raw {{(pid=83184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 18 11:59:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:11 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=122, name=volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" returned: 0 in 1.070s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:12 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_3w4kvc7hdevstack@QuobyteHD, size 112.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 11:59:12 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Converted 112.00 MB image at 101.67 MB/s Sep 18 11:59:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab 1G" returned: 0 in 0.126s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:12 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3a6724-7749-47b4-9c5d-e2da7b6992f9]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" returned: 0 in 0.393s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" returned: 1 in 0.348s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Downloaded image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}])) to volume 8c28f27f-e1ee-48c4-a746-e2bf6062aeab successfully. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Temporary image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 for user cd490ee4fa01402fba3aef94acc8313b is deleted. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Marking volume 8c28f27f-e1ee-48c4-a746-e2bf6062aeab as bootable. {{(pid=83184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Copying metadata from image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 to 8c28f27f-e1ee-48c4-a746-e2bf6062aeab. {{(pid=83184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 11:59:13 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Creating volume glance metadata for volume 8c28f27f-e1ee-48c4-a746-e2bf6062aeab backed by image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 11:59:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02911d5b-1ac7-4b35-a463-5887a9a61fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba94732a-3856-48a8-9fa8-95dfc10d9ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:14 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Volume volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab (8c28f27f-e1ee-48c4-a746-e2bf6062aeab): created successfully Sep 18 11:59:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba94732a-3856-48a8-9fa8-95dfc10d9ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Flow 'volume_create_manager' (eb36b81c-914a-4027-ac93-2dd6beb09378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:14 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-93867c3b-04d5-468d-bcad-2c3acac924cc tempest-VolumesImageMetadata-580272560 None] Created volume successfully. Sep 18 11:59:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Acquiring lock "cinder-8c28f27f-e1ee-48c4-a746-e2bf6062aeab-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Lock "cinder-8c28f27f-e1ee-48c4-a746-e2bf6062aeab-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Acquiring lock "cinder-quobyte-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Lock "cinder-quobyte-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" acquired by "delete_volume" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34409214-a1b5-42c1-bd0e-5fa946352a30]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" returned: 0 in 0.364s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" returned: 1 in 0.361s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 11:59:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Lock "cinder-quobyte-8c28f27f-e1ee-48c4-a746-e2bf6062aeab" released by "delete_volume" :: held 1.020s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Created reservations ['09f80981-fe1a-4422-ad60-8718b556aedf', '86115efa-3af7-440b-9cb9-d8000c80ede8', 'ae21a185-2024-4cad-9d1b-28ba6c13c276', 'db7cb5e5-07c2-457a-a26d-fa1360b60d73'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:59:17 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Deleted volume successfully. Sep 18 11:59:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b8ab27e7-8888-4e5b-839e-25af57442db0 tempest-VolumesImageMetadata-580272560 None] Lock "cinder-8c28f27f-e1ee-48c4-a746-e2bf6062aeab-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:21 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Flow 'volume_create_manager' (88aeece7-1423-449e-ac15-d1ea42f02bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cefbb51-242b-4c20-af3e-b1dec70da8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cefbb51-242b-4c20-af3e-b1dec70da8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1563289513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a7ebd8-266a-4e58-879b-e0aa1888cb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ff310a26564369bfb6d897c0524fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:21Z,use_quota=True,user_id='5c45171111a94cd38aaf101609ab3f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f3fd80-5d70-4874-812c-6cd12e17bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f3fd80-5d70-4874-812c-6cd12e17bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126475c3-8159-405d-b517-c88971f5931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126475c3-8159-405d-b517-c88971f5931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a7ebd8-266a-4e58-879b-e0aa1888cb26', 'volume_name': 'volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8769880-a64a-4fcb-91a5-6884f67cb8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8769880-a64a-4fcb-91a5-6884f67cb8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826420c6-f6f2-4f6a-b376-be258964ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:21 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Volume 12a7ebd8-266a-4e58-879b-e0aa1888cb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26', 'volume_size': 1} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1563289513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a7ebd8-266a-4e58-879b-e0aa1888cb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ff310a26564369bfb6d897c0524fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:21Z,use_quota=True,user_id='5c45171111a94cd38aaf101609ab3f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Creating volume 12a7ebd8-266a-4e58-879b-e0aa1888cb26 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:59:21 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:59:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:21 devstack quobyte-client[83210]: System call of process 97309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:59:21 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=123, name=volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26 1073741824" returned: 0 in 0.313s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] <== create_volume: return (462ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.476s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826420c6-f6f2-4f6a-b376-be258964ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce09113-e1b7-4c31-b63d-18e1cc12b0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:22 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Volume volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26 (12a7ebd8-266a-4e58-879b-e0aa1888cb26): created successfully Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce09113-e1b7-4c31-b63d-18e1cc12b0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:22 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Flow 'volume_create_manager' (88aeece7-1423-449e-ac15-d1ea42f02bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:22 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-c3319ed3-515b-404e-a76f-daf932ba39d3 tempest-AbsoluteLimitsTests-1761735598 None] Created volume successfully. Sep 18 11:59:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Acquiring lock "cinder-12a7ebd8-266a-4e58-879b-e0aa1888cb26-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:23 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Lock "cinder-12a7ebd8-266a-4e58-879b-e0aa1888cb26-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:24 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Acquiring lock "cinder-quobyte-12a7ebd8-266a-4e58-879b-e0aa1888cb26" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Lock "cinder-quobyte-12a7ebd8-266a-4e58-879b-e0aa1888cb26" acquired by "delete_volume" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa842148-4925-43ec-9f78-a2fc8448cae6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26" returned: 0 in 0.401s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-12a7ebd8-266a-4e58-879b-e0aa1888cb26" returned: 0 in 0.106s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Lock "cinder-quobyte-12a7ebd8-266a-4e58-879b-e0aa1888cb26" released by "delete_volume" :: held 0.641s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:24 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Created reservations ['833d7578-2139-4925-8842-0f96470202f6', 'bb4c77be-70d4-4374-b21d-960a1d65e81c', 'f5060c31-1211-49ca-ada4-66e9e4f6dd0f', 'c2b3648a-a06b-462d-ba17-3be2e89471f9'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.107s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:59:25 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Deleted volume successfully. Sep 18 11:59:25 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f58c46e-e6d7-4c73-a4dd-62c3f9c9fc4a tempest-AbsoluteLimitsTests-1761735598 None] Lock "cinder-12a7ebd8-266a-4e58-879b-e0aa1888cb26-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:29 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:29 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Flow 'volume_create_manager' (e74e67f3-23cd-4f25-8894-963064c97ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4e3a5d-7004-4aaf-85c4-a62c68b6c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4e3a5d-7004-4aaf-85c4-a62c68b6c33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1733160364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d0ba0e-50c5-4610-9903-97fcb95ec447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81048dbba211488facfe3f8e212c0dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:30Z,use_quota=True,user_id='f28f8bcdc3e94e2ca96bd1edb917a847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3379864-4a8c-44fa-8c38-edaac8fac78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3379864-4a8c-44fa-8c38-edaac8fac78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a8aaf0-c2f0-4d17-ba93-4cde7a8fbe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a8aaf0-c2f0-4d17-ba93-4cde7a8fbe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d0ba0e-50c5-4610-9903-97fcb95ec447', 'volume_name': 'volume-03d0ba0e-50c5-4610-9903-97fcb95ec447', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec2a6c8-cbc4-46d5-8a75-e9cada9a77b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec2a6c8-cbc4-46d5-8a75-e9cada9a77b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1984c2bd-5b61-4844-a607-d733fd807706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:30 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Volume 03d0ba0e-50c5-4610-9903-97fcb95ec447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d0ba0e-50c5-4610-9903-97fcb95ec447', 'volume_size': 1} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1733160364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d0ba0e-50c5-4610-9903-97fcb95ec447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81048dbba211488facfe3f8e212c0dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:30Z,use_quota=True,user_id='f28f8bcdc3e94e2ca96bd1edb917a847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Creating volume 03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:59:30 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:30 devstack quobyte-client[83210]: System call of process 97319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:59:30 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=124, name=volume-03d0ba0e-50c5-4610-9903-97fcb95ec447, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 1073741824" returned: 0 in 0.331s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] <== create_volume: return (480ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1984c2bd-5b61-4844-a607-d733fd807706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d0ba0e-50c5-4610-9903-97fcb95ec447', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bd7dcd-86d9-4c9d-bad8-6808e7803bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:30 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Volume volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 (03d0ba0e-50c5-4610-9903-97fcb95ec447): created successfully Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bd7dcd-86d9-4c9d-bad8-6808e7803bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Flow 'volume_create_manager' (e74e67f3-23cd-4f25-8894-963064c97ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:30 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3405d3e1-905e-4632-91bf-4d30dc877002 tempest-VolumesDeleteCascade-1518630469 None] Created volume successfully. Sep 18 11:59:32 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Creating offline snapshot 189f273e-4847-4b72-81b2-887d5831492d of volume 03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:59:32 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f734fe80-06cf-426a-b15f-ec44b20efed6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447" returned: 0 in 0.392s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:33 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=125, name=volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d 1G" returned: 0 in 0.248s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img rebase -u -b volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d" returned: 0 in 0.139s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d" returned: 0 in 0.090s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d" returned: 0 in 0.087s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.info" returned: 0 in 0.087s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.info" returned: 0 in 0.081s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.491s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:34 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9cc3ba52-70ec-4661-b708-d936120f8ffb tempest-VolumesDeleteCascade-1518630469 None] Create snapshot completed successfully Sep 18 11:59:34 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Creating offline snapshot fd7af3ff-c33c-4dad-aaea-1bae5b588949 of volume 03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:59:34 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[504c63c3-284b-4b21-9b5e-13a9cdfebe97]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d" returned: 0 in 0.372s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d0ba0e-50c5-4610-9903-97fcb95ec447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:35 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=127, name=volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 1G" returned: 0 in 0.250s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img rebase -u -b volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949" returned: 0 in 0.121s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949" returned: 0 in 0.081s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949" returned: 0 in 0.112s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.210s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b4881576-e78b-45f2-b059-5402cd5b0e59 tempest-VolumesDeleteCascade-1518630469 None] Create snapshot completed successfully Sep 18 11:59:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-03d0ba0e-50c5-4610-9903-97fcb95ec447-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-03d0ba0e-50c5-4610-9903-97fcb95ec447-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:36 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Performing cascade delete. {{(pid=83184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-189f273e-4847-4b72-81b2-887d5831492d-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-189f273e-4847-4b72-81b2-887d5831492d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-189f273e-4847-4b72-81b2-887d5831492d" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-189f273e-4847-4b72-81b2-887d5831492d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Deleting offline snapshot 189f273e-4847-4b72-81b2-887d5831492d of volume 03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] snapshot_file for this snap is: volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beefc64-6844-4f1f-88b4-9b6df9496bb3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d" returned: 0 in 0.378s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d0ba0e-50c5-4610-9903-97fcb95ec447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0789dc23-2e43-4d10-a3a5-835d10ed94e3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447" returned: 0 in 0.380s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c53a3da-3251-41ee-bcec-c9839dccf033]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949" returned: 0 in 0.388s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d0ba0e-50c5-4610-9903-97fcb95ec447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dcd466-2807-449e-af25-8b381bfd2637]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d" returned: 0 in 0.362s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d0ba0e-50c5-4610-9903-97fcb95ec447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c82469-9afb-4474-95f2-f180889834f4]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447" returned: 0 in 0.448s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d" returned: 0 in 0.210s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.189f273e-4847-4b72-81b2-887d5831492d" returned: 0 in 0.085s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 -F qcow2 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:39 devstack quobyte-client[83210]: System call of process 97367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 11:59:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img rebase -u -b volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 -F qcow2" returned: 0 in 0.134s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-189f273e-4847-4b72-81b2-887d5831492d" released by "_delete_snapshot" :: held 2.919s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" released by "delete_snapshot" :: held 2.939s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=69,cinder:SELECT=48,cinder:INSERT=11,cinder:DELETE=4 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=53,cinder:UPDATE=63,cinder:DELETE=11,cinder:INSERT=26 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Created reservations ['631a5719-6cd6-4030-ab80-6183a2a2b5c7', '6e38c55d-4d92-4cab-a500-d0dafeb274ec', '3f513274-2faf-4e38-840c-685189a65170', '8032a303-1c49-43bb-934c-e26e5e77f5c4'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:59:40 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Delete snapshot completed successfully. Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-189f273e-4847-4b72-81b2-887d5831492d-delete_snapshot" released by "delete_snapshot" :: held 3.417s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-fd7af3ff-c33c-4dad-aaea-1bae5b588949-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-fd7af3ff-c33c-4dad-aaea-1bae5b588949-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:40 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-fd7af3ff-c33c-4dad-aaea-1bae5b588949" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-fd7af3ff-c33c-4dad-aaea-1bae5b588949" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Deleting offline snapshot fd7af3ff-c33c-4dad-aaea-1bae5b588949 of volume 03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] snapshot_file for this snap is: volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9aac45-b07d-481c-8b07-057f40198dfd]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949" returned: 0 in 0.354s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d0ba0e-50c5-4610-9903-97fcb95ec447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab955271-3173-4931-8671-16585a7d22c1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447" returned: 0 in 0.408s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949" returned: 0 in 0.175s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447.fd7af3ff-c33c-4dad-aaea-1bae5b588949" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-fd7af3ff-c33c-4dad-aaea-1bae5b588949" released by "_delete_snapshot" :: held 1.299s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" released by "delete_snapshot" :: held 1.321s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Created reservations ['32f3bce1-52de-4a2d-8095-aa810ac46bb5', '72480c96-39d7-4280-bcc8-20e13e903a38', 'd76b75ac-e178-4b3b-bb44-2128a0e4c273', '869d33e4-514d-4223-b23e-13c13f59c273'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:59:42 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Delete snapshot completed successfully. Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-fd7af3ff-c33c-4dad-aaea-1bae5b588949-delete_snapshot" released by "delete_snapshot" :: held 1.822s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Snapshots deleted, issuing volume delete {{(pid=83184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" acquired by "delete_volume" :: waited 0.017s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1704c853-b7b9-47f8-8faa-c577b327e6c0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447" returned: 0 in 0.385s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-03d0ba0e-50c5-4610-9903-97fcb95ec447" returned: 0 in 0.086s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-03d0ba0e-50c5-4610-9903-97fcb95ec447" released by "delete_volume" :: held 0.648s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Created reservations ['f4ef04bb-bf0f-42bf-bfbe-8c6ab0441bf8', '413c38d2-eb01-4798-8b6b-94ccd099e80c', '9de7ddf2-4548-4c93-9660-9decd2e9d808', '524c6252-6140-4b34-92dd-12824e37a642'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.103s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:59:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Deleted volume successfully. Sep 18 11:59:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f63aeee4-083c-4b8f-b508-ee84d792a849 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-03d0ba0e-50c5-4610-9903-97fcb95ec447-delete_volume" released by "delete_volume" :: held 7.045s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:44 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Flow 'volume_create_manager' (0e84b404-dfd7-4097-86c8-e60964de46af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeef8cb5-4953-4895-bb0b-34eadd1430b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeef8cb5-4953-4895-bb0b-34eadd1430b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-606976639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81048dbba211488facfe3f8e212c0dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:44Z,use_quota=True,user_id='f28f8bcdc3e94e2ca96bd1edb917a847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e6ae35-2843-4096-987b-a4120bb1b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e6ae35-2843-4096-987b-a4120bb1b468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee0c4a5-b22e-4e11-9402-14c5bca62966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee0c4a5-b22e-4e11-9402-14c5bca62966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1', 'volume_name': 'volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca850af-c37c-4e19-97e0-2188bc8d9b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca850af-c37c-4e19-97e0-2188bc8d9b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7acc940-2419-45f3-89ca-25491d88c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:44 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Volume 6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1', 'volume_size': 1} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-606976639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81048dbba211488facfe3f8e212c0dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:44Z,use_quota=True,user_id='f28f8bcdc3e94e2ca96bd1edb917a847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Creating volume 6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:59:44 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 11:59:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.584s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 11:59:45 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=128, name=volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 1073741824" returned: 0 in 0.379s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] <== create_volume: return (553ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.571s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7acc940-2419-45f3-89ca-25491d88c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06d4def-e6b4-464c-bd32-7a3e5a9f2acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:45 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Volume volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 (6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1): created successfully Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06d4def-e6b4-464c-bd32-7a3e5a9f2acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Flow 'volume_create_manager' (0e84b404-dfd7-4097-86c8-e60964de46af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2d4cf16c-aad7-46d3-b6bd-ab15214bf5dc tempest-VolumesDeleteCascade-1518630469 None] Created volume successfully. Sep 18 11:59:46 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Creating offline snapshot 432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a of volume 6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 11:59:46 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb8fdfe-b3c6-4b5e-89c9-902c8d7c6856]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" returned: 0 in 0.410s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:47 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=129, name=volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a 1G" returned: 0 in 0.227s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img rebase -u -b volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" returned: 0 in 0.138s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" returned: 0 in 0.081s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" returned: 0 in 0.116s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.info" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:59:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.info" returned: 0 in 0.094s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.502s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:48 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d3135066-ff5f-488a-8ddb-7a6fb90b0d4e tempest-VolumesDeleteCascade-1518630469 None] Create snapshot completed successfully Sep 18 11:59:49 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Flow 'volume_create_manager' (3a1a7a3e-bf1c-4103-b787-3ce06a3d0067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa5e1b3-ae5f-4be2-9317-a6b5179f1060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa5e1b3-ae5f-4be2-9317-a6b5179f1060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T09:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-428430033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4edfc58f-9534-4de0-9fec-d267ccc0c0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81048dbba211488facfe3f8e212c0dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T09:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T09:59:49Z,use_quota=True,user_id='f28f8bcdc3e94e2ca96bd1edb917a847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379f1152-f58f-497d-bd73-a6b92ae9e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379f1152-f58f-497d-bd73-a6b92ae9e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b13de47-ee7c-4eef-9eb1-4cfdf2d73fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b13de47-ee7c-4eef-9eb1-4cfdf2d73fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4edfc58f-9534-4de0-9fec-d267ccc0c0ae', 'volume_name': 'volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae', 'volume_size': 1, 'snapshot_id': '432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a'}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509785df-f306-4de7-888a-00b2867febcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509785df-f306-4de7-888a-00b2867febcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20293aa-1596-466c-967c-6372c92db5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:49 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Volume 4edfc58f-9534-4de0-9fec-d267ccc0c0ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae', 'volume_size': 1, 'snapshot_id': '432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a'} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" by "_create_volume_from_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Creating volume 4edfc58f-9534-4de0-9fec-d267ccc0c0ae from snapshot 432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" by "_copy_volume_from_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] snapshot: 432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a, volume: 4edfc58f-9534-4de0-9fec-d267ccc0c0ae, {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[707224d4-ee87-46a6-b7d9-566ec3b3e341]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" returned: 0 in 0.376s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Creating direct copy from snapshot {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa7c18a-f2de-4d40-a066-656a748a1359]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" returned: 0 in 0.405s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:50 devstack cinder-volume[83184]: DEBUG cinder.utils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae not found in is_blk_device check {{(pid=83184) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 18 11:59:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:50 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=131, name=volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 11:59:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" returned: 0 in 6.250s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:56 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7831e22-39c3-4807-9720-e1e97ff6addb]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" returned: 0 in 0.513s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Image conversion details: src /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 11:59:57 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Converted 1024.00 MB image at 163.18 MB/s Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" returned: 0 in 0.087s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" released by "_copy_volume_from_snapshot" :: held 8.026s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" released by "_create_volume_from_snapshot" :: held 8.061s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.088s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20293aa-1596-466c-967c-6372c92db5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae', 'volume_size': 1, 'snapshot_id': '432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a'}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df84769a-24f4-47af-bd44-ac49729578f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 11:59:57 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Volume volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae (4edfc58f-9534-4de0-9fec-d267ccc0c0ae): created successfully Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df84769a-24f4-47af-bd44-ac49729578f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 11:59:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Flow 'volume_create_manager' (3a1a7a3e-bf1c-4103-b787-3ce06a3d0067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 11:59:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ff6f057d-f935-4b9c-b3b5-c0114728df8d tempest-VolumesDeleteCascade-1518630469 None] Created volume successfully. Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:58 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Performing cascade delete. {{(pid=83184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:58 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Deleting offline snapshot 432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a of volume 6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] snapshot_file for this snap is: volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ceec5-feb3-4e0c-9f50-fefc81af5aee]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" returned: 0 in 0.393s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[228d075c-32c7-458a-bd6e-4fd7d841a7da]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" returned: 0 in 0.397s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" returned: 0 in 0.204s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 11:59:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1.432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a" released by "_delete_snapshot" :: held 1.436s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" released by "delete_snapshot" :: held 1.462s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Created reservations ['071abfcc-beda-43b7-9148-917893c8ba50', '24e830fe-d2ce-402d-9b0f-96f83efbc623', '03d619d5-5de9-402c-9c3e-65c920157024', '4d2995b8-de3a-4f9b-919f-8741d259f7dc'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:00:00 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Delete snapshot completed successfully. Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-432a2e78-d3ab-43f1-bfd8-f10d3f1b0b5a-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Snapshots deleted, issuing volume delete {{(pid=83184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0058d6-4b59-4cae-8f46-2fee81a077e7]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" returned: 0 in 0.405s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" returned: 0 in 0.085s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1" released by "delete_volume" :: held 0.684s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Created reservations ['ba122696-04be-4910-9492-0d38c1ddde3c', 'a3ce30c9-8c49-4731-a17c-b0ba2f8d0a1c', 'a1d125af-59fe-48ed-bfd5-3a54913a12b8', 'c55a8dee-2f2c-4534-a25a-bff9026fdfb6'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.110s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:01 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:00:01 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Deleted volume successfully. Sep 18 12:00:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a2666d77-2e42-42d8-8454-dddb9589ce75 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-6a8a026a-29d7-4f8f-97dd-23fcf9a6c8d1-delete_volume" released by "delete_volume" :: held 3.733s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-4edfc58f-9534-4de0-9fec-d267ccc0c0ae-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:00:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-4edfc58f-9534-4de0-9fec-d267ccc0c0ae-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:00:02 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:00:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "cinder-quobyte-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:00:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" acquired by "delete_volume" :: waited 0.010s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:00:02 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c692342e-93c1-4118-a677-bb59cdab1d27]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:00:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" returned: 0 in 0.396s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" returned: 0 in 0.118s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-quobyte-4edfc58f-9534-4de0-9fec-d267ccc0c0ae" released by "delete_volume" :: held 0.662s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Created reservations ['70a651cf-8c0e-481d-98ae-4601f71a199f', '32ec1b38-8fbc-4e1a-8599-218ff4247b90', '56d8cfc7-e531-4c08-85dd-d0bb70b93637', 'c785f3bf-9f84-4b78-95c2-46adc9159927'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:00:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.104s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:04 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:00:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Deleted volume successfully. Sep 18 12:00:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-28ed0971-8d63-4c77-ac50-0b3935afe2c5 tempest-VolumesDeleteCascade-1518630469 None] Lock "cinder-4edfc58f-9534-4de0-9fec-d267ccc0c0ae-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:13 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=34,cinder:INSERT=15,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:00:14 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:INSERT=9,cinder:UPDATE=39,cinder:SELECT=33,cinder:DELETE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:00:17 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Flow 'volume_create_manager' (ff20acc3-e604-43d6-9f2b-795a651a60f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e2e677-0150-4c69-809a-ca06cd0eb608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e2e677-0150-4c69-809a-ca06cd0eb608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996490998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1396018-0843-4671-9cf0-ebace16af39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e567e9d7837439d806a30256c53da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:17Z,use_quota=True,user_id='761c5a5cefb5402e85a266f0d997b308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99d4ec4-da9a-4781-8863-14bbd927aefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99d4ec4-da9a-4781-8863-14bbd927aefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fcb729-633d-45ee-978f-59d19a6afbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fcb729-633d-45ee-978f-59d19a6afbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1396018-0843-4671-9cf0-ebace16af39c', 'volume_name': 'volume-b1396018-0843-4671-9cf0-ebace16af39c', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10b5257-7e4d-4ea9-a5e9-e20df2166ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10b5257-7e4d-4ea9-a5e9-e20df2166ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf5d1fd-9a1a-441c-b564-e2aa664bce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:00:17 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Volume b1396018-0843-4671-9cf0-ebace16af39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1396018-0843-4671-9cf0-ebace16af39c', 'volume_size': 1} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996490998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1396018-0843-4671-9cf0-ebace16af39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e567e9d7837439d806a30256c53da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:00:17Z,use_quota=True,user_id='761c5a5cefb5402e85a266f0d997b308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Creating volume b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:00:17 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:17 devstack quobyte-client[83210]: System call of process 97491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:00:17 devstack quobyte-client[83210]: System call of process 97491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:00:17 devstack quobyte-client[83210]: System call of process 97491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:00:17 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=132, name=volume-b1396018-0843-4671-9cf0-ebace16af39c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c 1073741824" returned: 0 in 0.351s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.081s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] <== create_volume: return (500ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.513s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:00:17 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf5d1fd-9a1a-441c-b564-e2aa664bce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1396018-0843-4671-9cf0-ebace16af39c', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:00:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f12471-0fb2-4b9a-abe5-a41d0416790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:00:18 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Volume volume-b1396018-0843-4671-9cf0-ebace16af39c (b1396018-0843-4671-9cf0-ebace16af39c): created successfully Sep 18 12:00:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f12471-0fb2-4b9a-abe5-a41d0416790f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:00:18 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Flow 'volume_create_manager' (ff20acc3-e604-43d6-9f2b-795a651a60f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:00:18 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b7ea7834-d325-409d-a509-0a1fd830c85b tempest-VolumesActionsTest-500796809 None] Created volume successfully. Sep 18 12:00:28 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:00:28 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:00:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a21bc3bd-2520-4131-8e9c-6945f3305d7e tempest-VolumesActionsTest-500796809 None] Acquiring lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c" by "attach_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:00:42 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a21bc3bd-2520-4131-8e9c-6945f3305d7e tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c" acquired by "attach_volume" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:00:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a21bc3bd-2520-4131-8e9c-6945f3305d7e tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:00:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a21bc3bd-2520-4131-8e9c-6945f3305d7e tempest-VolumesActionsTest-500796809 None] Attaching volume b1396018-0843-4671-9cf0-ebace16af39c to instance 0ceed932-ab6f-4a12-85b3-7b2716cf9e3f at mountpoint /dev/vdb on host None. Sep 18 12:00:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a21bc3bd-2520-4131-8e9c-6945f3305d7e tempest-VolumesActionsTest-500796809 None] Attach volume completed successfully. Sep 18 12:00:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a21bc3bd-2520-4131-8e9c-6945f3305d7e tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c" released by "attach_volume" :: held 0.269s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e19ba8b2-2af0-480a-8317-e1186b07528b tempest-VolumesActionsTest-500796809 None] Acquiring lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-detach_volume" by "detach_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:00:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e19ba8b2-2af0-480a-8317-e1186b07528b tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:00:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e19ba8b2-2af0-480a-8317-e1186b07528b tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:00:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e19ba8b2-2af0-480a-8317-e1186b07528b tempest-VolumesActionsTest-500796809 None] Detaching volume b1396018-0843-4671-9cf0-ebace16af39c from instance 0ceed932-ab6f-4a12-85b3-7b2716cf9e3f. Sep 18 12:00:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e19ba8b2-2af0-480a-8317-e1186b07528b tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:00:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e19ba8b2-2af0-480a-8317-e1186b07528b tempest-VolumesActionsTest-500796809 None] Detach volume completed successfully. Sep 18 12:00:43 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e19ba8b2-2af0-480a-8317-e1186b07528b tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.150s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:00:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:00:53 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:INSERT=2,cinder:SELECT=4,cinder:UPDATE=5 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:00:53 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:01:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b67a390e-3f1f-4663-a117-052d9cc35c98 tempest-VolumesActionsTest-500796809 None] Acquiring lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c" by "attach_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:01:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b67a390e-3f1f-4663-a117-052d9cc35c98 tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c" acquired by "attach_volume" :: waited 0.043s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:01:16 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b67a390e-3f1f-4663-a117-052d9cc35c98 tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:01:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b67a390e-3f1f-4663-a117-052d9cc35c98 tempest-VolumesActionsTest-500796809 None] Attaching volume b1396018-0843-4671-9cf0-ebace16af39c to instance 9f132360-16cf-4b52-aae0-043c75898b68 at mountpoint /dev/vdb on host None. Sep 18 12:01:16 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b67a390e-3f1f-4663-a117-052d9cc35c98 tempest-VolumesActionsTest-500796809 None] Attach volume completed successfully. Sep 18 12:01:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b67a390e-3f1f-4663-a117-052d9cc35c98 tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c" released by "attach_volume" :: held 0.432s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:01:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c3f3927-a199-4599-9591-14403c549a72 tempest-VolumesActionsTest-500796809 None] Acquiring lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-detach_volume" by "detach_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:01:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c3f3927-a199-4599-9591-14403c549a72 tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:01:17 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4c3f3927-a199-4599-9591-14403c549a72 tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:01:17 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4c3f3927-a199-4599-9591-14403c549a72 tempest-VolumesActionsTest-500796809 None] Detaching volume b1396018-0843-4671-9cf0-ebace16af39c from instance 9f132360-16cf-4b52-aae0-043c75898b68. Sep 18 12:01:17 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4c3f3927-a199-4599-9591-14403c549a72 tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:01:17 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4c3f3927-a199-4599-9591-14403c549a72 tempest-VolumesActionsTest-500796809 None] Detach volume completed successfully. Sep 18 12:01:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4c3f3927-a199-4599-9591-14403c549a72 tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:01:27 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:INSERT=1,cinder:SELECT=3,cinder:UPDATE=4 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:01:27 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:01:28 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:01:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:01:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:01:28 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e1ccc0-746f-40dd-a78c-02d84301a854]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:01:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:01:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.429s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:01:29 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba7407-f718-49de-b027-bd634bd7b1a1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:01:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:01:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.402s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:01:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.bd116e98-27a0-46c0-90a6-ffc8e69a234eb42sg668.img {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:01:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.bd116e98-27a0-46c0-90a6-ffc8e69a234eb42sg668.img" returned: 0 in 5.896s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:01:35 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca4157b-93d0-4a43-a2c0-9adecc787a81]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:01:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:01:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.519s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:01:36 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Image conversion details: src /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.bd116e98-27a0-46c0-90a6-ffc8e69a234eb42sg668.img {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 12:01:36 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Converted 1024.00 MB image at 173.02 MB/s Sep 18 12:01:36 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] bd116e98-27a0-46c0-90a6-ffc8e69a234e was raw, no need to convert to raw {{(pid=83184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 18 12:01:38 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.212s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:01:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:01:46 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:01:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:01:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:02:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 45.627s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Uploaded volume to glance image-id: bd116e98-27a0-46c0-90a6-ffc8e69a234e. {{(pid=83184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 18 12:02:14 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9fe24a62-6b1c-4380-87c3-ae3dc62c1c5b tempest-VolumesActionsTest-500796809 None] Copy volume to image completed successfully. Sep 18 12:02:15 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:15 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3b402c-8957-43e6-862a-6faf34e52dde]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.402s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:16 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e14aa7f-f34e-4597-bbec-d68fe66ff5ef]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.362s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img" returned: 0 in 5.604s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:22 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1ac63-6cc7-4595-9d22-2db0c6c03505]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.546s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Image conversion details: src /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 12:02:23 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Converted 1024.00 MB image at 181.90 MB/s Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] 1fb643d2-46e0-48be-9dde-deea264dc7aa was raw, converting to qcow2 {{(pid=83184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4559d771-c652-4c3b-beba-fe5945d46a56]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img" returned: 0 in 0.345s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img" returned: 1 in 0.325s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:02:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img /opt/stack/data/cinder/conversion/vol_upload_ij4ikfa6 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img /opt/stack/data/cinder/conversion/vol_upload_ij4ikfa6" returned: 0 in 0.184s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:24 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Image conversion details: src /opt/stack/data/cinder/conversion/b1396018-0843-4671-9cf0-ebace16af39c.temp_image.1fb643d2-46e0-48be-9dde-deea264dc7aafh6dexj1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ij4ikfa6 {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 12:02:24 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 18 12:02:24 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8fac2b-164b-4e03-9274-7a2335d87fcb]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ij4ikfa6 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ij4ikfa6" returned: 0 in 0.426s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.941s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Uploaded volume to glance image-id: 1fb643d2-46e0-48be-9dde-deea264dc7aa. {{(pid=83184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 18 12:02:25 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:02:26 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5778ce8a-140f-46f8-a10f-a1b1f7c0360b tempest-VolumesActionsTest-500796809 None] Copy volume to image completed successfully. Sep 18 12:02:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Acquiring lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Acquiring lock "cinder-quobyte-b1396018-0843-4671-9cf0-ebace16af39c" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Lock "cinder-quobyte-b1396018-0843-4671-9cf0-ebace16af39c" acquired by "delete_volume" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:27 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d26d67-608a-4c8c-b1d2-b4bc3ca289ed]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.392s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b1396018-0843-4671-9cf0-ebace16af39c" returned: 0 in 0.104s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Lock "cinder-quobyte-b1396018-0843-4671-9cf0-ebace16af39c" released by "delete_volume" :: held 0.621s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Created reservations ['9331d07e-087c-485d-9428-0879d683dcfe', '1ec0e4c8-7c83-42e2-8138-7522d0d46087', '21b1d2aa-1c3f-4b4a-828f-24b0bed022a8', '83f37cdb-5b28-4542-b4c8-54648bc0b5d7'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.118s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:02:28 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Deleted volume successfully. Sep 18 12:02:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-58fb771b-0844-4a71-88d9-6df30f37b229 tempest-VolumesActionsTest-500796809 None] Lock "cinder-b1396018-0843-4671-9cf0-ebace16af39c-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:36 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Flow 'volume_create_manager' (f00a35cf-b46f-4fc6-b837-2cf332549471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88aa6e1-7eaa-4546-adfd-33bf5436f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88aa6e1-7eaa-4546-adfd-33bf5436f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1244010009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a326ec12-8090-48aa-9b39-650348a70475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92adb64562a8422a90f3d779dc364011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:02:36Z,use_quota=True,user_id='fdc3defe9e61454eb56afdab6b80ec83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20cd277-aeeb-48c9-90e5-c44e63b5f8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20cd277-aeeb-48c9-90e5-c44e63b5f8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b865439-3bde-4aff-98bb-704772ccd04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b865439-3bde-4aff-98bb-704772ccd04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a326ec12-8090-48aa-9b39-650348a70475', 'volume_name': 'volume-a326ec12-8090-48aa-9b39-650348a70475', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a39b44-2e8e-465e-8e35-26e42ccadd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a39b44-2e8e-465e-8e35-26e42ccadd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44150dd-10a4-42c8-ae34-a5c94fec12b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:36 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume a326ec12-8090-48aa-9b39-650348a70475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a326ec12-8090-48aa-9b39-650348a70475', 'volume_size': 1} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1244010009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a326ec12-8090-48aa-9b39-650348a70475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92adb64562a8422a90f3d779dc364011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:02:36Z,use_quota=True,user_id='fdc3defe9e61454eb56afdab6b80ec83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Creating volume a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:02:36 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:36 devstack quobyte-client[83210]: System call of process 97939 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:02:36 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=133, name=volume-a326ec12-8090-48aa-9b39-650348a70475, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 1073741824" returned: 0 in 0.338s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475" returned: 0 in 0.079s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44150dd-10a4-42c8-ae34-a5c94fec12b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a326ec12-8090-48aa-9b39-650348a70475', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d67b5a7-db0b-4044-9d1a-e66947baedfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:37 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume volume-a326ec12-8090-48aa-9b39-650348a70475 (a326ec12-8090-48aa-9b39-650348a70475): created successfully Sep 18 12:02:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d67b5a7-db0b-4044-9d1a-e66947baedfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Flow 'volume_create_manager' (f00a35cf-b46f-4fc6-b837-2cf332549471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:02:37 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-62102553-39b9-4c2f-87a6-5ec282a51104 tempest-VolumesSnapshotListTestJSON-1000834261 None] Created volume successfully. Sep 18 12:02:38 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Creating offline snapshot cb2e8246-c21e-466c-80b7-f42ac551ed44 of volume a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 12:02:38 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67711b63-671f-4d4d-b1ad-e234e78cfe08]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475" returned: 0 in 0.391s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:39 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=134, name=volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 1G" returned: 0 in 0.218s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a326ec12-8090-48aa-9b39-650348a70475 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img rebase -u -b volume-a326ec12-8090-48aa-9b39-650348a70475 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44" returned: 0 in 0.125s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44" returned: 0 in 0.092s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44" returned: 0 in 0.107s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.info" returned: 0 in 0.085s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.info" returned: 0 in 0.080s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.388s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:40 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e74bff7f-e9b8-4f2a-bfe8-80b3df71c3b5 tempest-VolumesSnapshotListTestJSON-1000834261 None] Create snapshot completed successfully Sep 18 12:02:40 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Creating offline snapshot f3d5aadb-14f9-4a0d-b154-1a4793df821a of volume a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 12:02:40 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2ac964-5beb-43b4-a69f-3a384c38e97f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44" returned: 0 in 0.357s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a326ec12-8090-48aa-9b39-650348a70475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:41 devstack quobyte-client[83210]: System call of process 97960 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:02:41 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=136, name=volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a 1G" returned: 0 in 0.279s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img rebase -u -b volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a" returned: 0 in 0.133s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a" returned: 0 in 0.082s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a" returned: 0 in 0.103s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.216s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:42 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a693547e-a6af-4286-8690-948638337639 tempest-VolumesSnapshotListTestJSON-1000834261 None] Create snapshot completed successfully Sep 18 12:02:42 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Creating offline snapshot 9375e7be-75f7-4ea0-aa47-f8b0e947f219 of volume a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979b9ab-7b13-4440-bebc-e7f6042a0183]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a" returned: 0 in 0.381s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a326ec12-8090-48aa-9b39-650348a70475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:43 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=137, name=volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 1G" returned: 0 in 0.298s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img rebase -u -b volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219" returned: 0 in 0.127s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:02:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219" returned: 0 in 0.076s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219" returned: 0 in 0.107s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.212s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:44 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-47e11910-f5a2-460d-8817-006d31b6cc3e tempest-VolumesSnapshotListTestJSON-1000834261 None] Create snapshot completed successfully Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-9375e7be-75f7-4ea0-aa47-f8b0e947f219-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-9375e7be-75f7-4ea0-aa47-f8b0e947f219-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:46 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-quobyte-9375e7be-75f7-4ea0-aa47-f8b0e947f219" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-9375e7be-75f7-4ea0-aa47-f8b0e947f219" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Deleting offline snapshot 9375e7be-75f7-4ea0-aa47-f8b0e947f219 of volume a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] snapshot_file for this snap is: volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d084083-c8bf-4716-9f9a-fde24ee022f1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219" returned: 0 in 0.371s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a326ec12-8090-48aa-9b39-650348a70475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[60802c3f-dba3-4c3e-8793-76fd1e11851e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a" returned: 0 in 0.351s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a326ec12-8090-48aa-9b39-650348a70475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:02:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219" returned: 0 in 0.248s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.9375e7be-75f7-4ea0-aa47-f8b0e947f219" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-9375e7be-75f7-4ea0-aa47-f8b0e947f219" released by "_delete_snapshot" :: held 1.325s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" released by "delete_snapshot" :: held 1.348s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:47 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Created reservations ['1086c1f7-247a-46f2-a984-f1bc0c312a36', '2013b20f-c362-42bf-bd71-e0e4d3c3aa2e', '33720680-302a-4a3e-a4a0-8338a221b7f1', 'a9cf568e-9e81-473d-a731-a8db36b44531'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:02:47 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Delete snapshot completed successfully. Sep 18 12:02:47 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0f8b9486-0b5f-4aff-87f4-db516e9093b7 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-9375e7be-75f7-4ea0-aa47-f8b0e947f219-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-f3d5aadb-14f9-4a0d-b154-1a4793df821a-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-f3d5aadb-14f9-4a0d-b154-1a4793df821a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:48 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-quobyte-f3d5aadb-14f9-4a0d-b154-1a4793df821a" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-f3d5aadb-14f9-4a0d-b154-1a4793df821a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Deleting offline snapshot f3d5aadb-14f9-4a0d-b154-1a4793df821a of volume a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] snapshot_file for this snap is: volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e32fb3-ee3b-457c-9c2e-8c08e3ead568]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a" returned: 0 in 0.445s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a326ec12-8090-48aa-9b39-650348a70475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[822714fc-591e-4c4e-962b-fc916a54eb1e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44" returned: 0 in 0.482s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a326ec12-8090-48aa-9b39-650348a70475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:02:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:49 devstack quobyte-client[83210]: System call of process 98029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:02:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a" returned: 0 in 0.218s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.f3d5aadb-14f9-4a0d-b154-1a4793df821a" returned: 0 in 0.083s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-f3d5aadb-14f9-4a0d-b154-1a4793df821a" released by "_delete_snapshot" :: held 1.526s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" released by "delete_snapshot" :: held 1.550s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Created reservations ['0ca619d4-1cb5-4d21-bc8c-8806080d0fb1', '81022669-2033-4294-95e5-7f342c0de31b', 'd55024d8-243e-4662-b5a4-f1a7b02d0daf', '08149097-405d-417d-87fb-7eb8c90d359d'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:02:50 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Delete snapshot completed successfully. Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9a49df47-f2b4-4e94-b5c1-fc26f39ea735 tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-f3d5aadb-14f9-4a0d-b154-1a4793df821a-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-cb2e8246-c21e-466c-80b7-f42ac551ed44-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-cb2e8246-c21e-466c-80b7-f42ac551ed44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:50 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-quobyte-cb2e8246-c21e-466c-80b7-f42ac551ed44" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-cb2e8246-c21e-466c-80b7-f42ac551ed44" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Deleting offline snapshot cb2e8246-c21e-466c-80b7-f42ac551ed44 of volume a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] snapshot_file for this snap is: volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb18ac7-5740-4a56-a0da-0e28628fff14]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44" returned: 0 in 0.373s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a326ec12-8090-48aa-9b39-650348a70475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0109fa-3bc5-4e76-959a-a0179cf78104]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475" returned: 0 in 0.395s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44" returned: 0 in 0.186s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475.cb2e8246-c21e-466c-80b7-f42ac551ed44" returned: 0 in 0.081s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-cb2e8246-c21e-466c-80b7-f42ac551ed44" released by "_delete_snapshot" :: held 1.341s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" released by "delete_snapshot" :: held 1.363s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:52 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Created reservations ['46632d34-de63-4961-8587-79ba940499f3', '3b98f4f4-14ec-454e-89f7-1ecf1e1f2c25', '1da65c56-9086-49e1-8622-4a04abdff76f', '846687ee-15c2-4743-a962-470296bd3925'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:02:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Delete snapshot completed successfully. Sep 18 12:02:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-679e9edb-cc56-4fd7-8d54-5749887733ae tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-cb2e8246-c21e-466c-80b7-f42ac551ed44-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-a326ec12-8090-48aa-9b39-650348a70475-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-a326ec12-8090-48aa-9b39-650348a70475-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:02:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:02:52 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8476b1d-d074-42d4-ab56-33ee222980e6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475" returned: 0 in 0.384s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a326ec12-8090-48aa-9b39-650348a70475" returned: 0 in 0.109s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-quobyte-a326ec12-8090-48aa-9b39-650348a70475" released by "delete_volume" :: held 0.651s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Created reservations ['5f43e4cb-4728-422d-a3d7-05551596baed', '86438538-1cbc-4893-977e-76fbac82eb6b', '6b6b69b1-4581-4457-a29d-23b8bf063ffa', 'ed9f8688-1ed1-49b5-9f8f-d3b4ce997e5c'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.111s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:53 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:02:53 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Deleted volume successfully. Sep 18 12:02:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0b2d525d-e492-4745-905f-2e83b51cf03d tempest-VolumesSnapshotListTestJSON-1000834261 None] Lock "cinder-a326ec12-8090-48aa-9b39-650348a70475-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:02:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Flow 'volume_create_manager' (5d8520f2-cde9-460d-9ef9-a9114b3c7706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fdec55-d20c-4063-83a3-a5a4ef39066d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fdec55-d20c-4063-83a3-a5a4ef39066d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1372398515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb79cfed-0dc5-4dab-9770-5405a7ec10cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6cf1b2ff3346b2b6d9e9d3dce1f01a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:02:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:02:57Z,use_quota=True,user_id='67723f31fd5d4a488409b59f8f60d030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092bed8a-d692-4a6e-b333-f076db03e57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092bed8a-d692-4a6e-b333-f076db03e57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48155fe9-4ba8-4041-8a42-3ffa31d7c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48155fe9-4ba8-4041-8a42-3ffa31d7c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb79cfed-0dc5-4dab-9770-5405a7ec10cd', 'volume_name': 'volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd', 'volume_size': 2}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3f269d-4411-4fa9-b688-ccfec5dcdf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3f269d-4411-4fa9-b688-ccfec5dcdf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac00532a-bc7a-4fdc-b9d1-49d7674de0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:56 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Volume eb79cfed-0dc5-4dab-9770-5405a7ec10cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd', 'volume_size': 2} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1372398515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb79cfed-0dc5-4dab-9770-5405a7ec10cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6cf1b2ff3346b2b6d9e9d3dce1f01a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:02:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:02:57Z,use_quota=True,user_id='67723f31fd5d4a488409b59f8f60d030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Creating volume eb79cfed-0dc5-4dab-9770-5405a7ec10cd {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:02:56 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:02:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd 2147483648 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:57 devstack quobyte-client[83210]: System call of process 98048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:02:57 devstack quobyte-client[83210]: System call of process 98048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:02:57 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=138, name=volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd 2147483648" returned: 0 in 0.415s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" returned: 0 in 0.090s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] <== create_volume: return (594ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.606s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac00532a-bc7a-4fdc-b9d1-49d7674de0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd', 'volume_size': 2}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08b0c8f-fbbe-4be5-80de-3ece7ff4dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:02:57 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Volume volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd (eb79cfed-0dc5-4dab-9770-5405a7ec10cd): created successfully Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08b0c8f-fbbe-4be5-80de-3ece7ff4dddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:02:57 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Flow 'volume_create_manager' (5d8520f2-cde9-460d-9ef9-a9114b3c7706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:02:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b57e351b-72ce-4b9d-b86f-538a1222ecf2 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Created volume successfully. Sep 18 12:02:59 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Creating offline snapshot 55e63527-7d3a-4b2a-97a1-1c62f4423aae of volume eb79cfed-0dc5-4dab-9770-5405a7ec10cd {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ae62ae-df39-4abd-8f4c-1e716e2ef9ca]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" returned: 0 in 0.397s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae 2G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:02:59 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=139, name=volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae 2G" returned: 0 in 0.215s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:02:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): qemu-img rebase -u -b volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "qemu-img rebase -u -b volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae" returned: 0 in 0.119s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae" returned: 0 in 0.092s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae" returned: 0 in 0.081s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.info" returned: 0 in 0.092s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.info" returned: 0 in 0.079s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.395s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:03:00 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7763931e-4a0d-474f-87d9-c5f17afc6144 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Create snapshot completed successfully Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "cinder-55e63527-7d3a-4b2a-97a1-1c62f4423aae-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-55e63527-7d3a-4b2a-97a1-1c62f4423aae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:03:01 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "cinder-quobyte-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-quobyte-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "cinder-quobyte-55e63527-7d3a-4b2a-97a1-1c62f4423aae" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-quobyte-55e63527-7d3a-4b2a-97a1-1c62f4423aae" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Deleting offline snapshot 55e63527-7d3a-4b2a-97a1-1c62f4423aae of volume eb79cfed-0dc5-4dab-9770-5405a7ec10cd {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] snapshot_file for this snap is: volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b705d6-2be2-4cfe-a86f-fb738c4c137e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae" returned: 0 in 0.370s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ee37de-f8c7-48af-a546-575a5bcc4e4f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:03:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" returned: 0 in 0.406s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae" returned: 0 in 0.186s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd.55e63527-7d3a-4b2a-97a1-1c62f4423aae" returned: 0 in 0.085s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-quobyte-55e63527-7d3a-4b2a-97a1-1c62f4423aae" released by "_delete_snapshot" :: held 1.330s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:03:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-quobyte-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" released by "delete_snapshot" :: held 1.364s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:03:03 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Created reservations ['284d9da9-0771-4fac-b364-33d2a813e100', 'ca2f4150-d835-4854-b2c2-eb4389994c52', '3dd4fd7d-4007-4a53-8b34-12d492546c62', 'd4bdd65e-1966-4777-8280-c92e692ab6d5'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:03:03 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Delete snapshot completed successfully. Sep 18 12:03:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-7f80c7fc-d8cc-401a-a070-e58480aca207 tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-55e63527-7d3a-4b2a-97a1-1c62f4423aae-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:03:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "cinder-eb79cfed-0dc5-4dab-9770-5405a7ec10cd-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:03:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-eb79cfed-0dc5-4dab-9770-5405a7ec10cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:03:03 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:03:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "cinder-quobyte-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:03:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-quobyte-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" acquired by "delete_volume" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:03:03 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac235a4b-c37d-4e21-a25c-c66d04da7230]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:03:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" returned: 0 in 0.380s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" returned: 0 in 0.109s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-quobyte-eb79cfed-0dc5-4dab-9770-5405a7ec10cd" released by "delete_volume" :: held 0.634s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Created reservations ['e1927378-7ef2-4f45-be7d-eac8cbfa537d', '5a468d16-ef1a-474e-a0f2-75e91e590370', 'f951824e-e5a7-45e3-aeba-86cba01b3aee', '307fbb28-e0b2-425b-bc0d-4e6fed4425e3'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:04 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:03:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Deleted volume successfully. Sep 18 12:03:05 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d974b1c5-51e7-4709-ad58-3c52947f2d3c tempest-VolumesSnapshotNegativeTestJSON-1045150607 None] Lock "cinder-eb79cfed-0dc5-4dab-9770-5405a7ec10cd-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:03:14 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=49,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=4 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:03:15 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=37,cinder:INSERT=15,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.186s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:03:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:03:59 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Flow 'volume_create_manager' (05a1e81d-8b8c-4ae7-b9b1-e3034b05d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c16a7cd-ed39-40bb-ace6-d134e2a53788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c16a7cd-ed39-40bb-ace6-d134e2a53788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-19917310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acba91a-a498-4360-be96-f391b32be3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba0ad85cf974f179a971faafe832697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:03:59Z,use_quota=True,user_id='9992b4c69a004579990967af98a25eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19a90b3-3368-4f08-82f9-0b911c41d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19a90b3-3368-4f08-82f9-0b911c41d874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42965ba8-c480-437d-9d25-303ff37d92b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42965ba8-c480-437d-9d25-303ff37d92b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8acba91a-a498-4360-be96-f391b32be3bb', 'volume_name': 'volume-8acba91a-a498-4360-be96-f391b32be3bb', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf0219e-b12b-4cb2-b338-6945966650c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf0219e-b12b-4cb2-b338-6945966650c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125f1a1d-44de-4076-824e-050cd3f66a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:03:59 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Volume 8acba91a-a498-4360-be96-f391b32be3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8acba91a-a498-4360-be96-f391b32be3bb', 'volume_size': 1} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-19917310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acba91a-a498-4360-be96-f391b32be3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba0ad85cf974f179a971faafe832697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:03:59Z,use_quota=True,user_id='9992b4c69a004579990967af98a25eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Creating volume 8acba91a-a498-4360-be96-f391b32be3bb {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:03:59 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:59 devstack quobyte-client[83210]: System call of process 98241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:03:59 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=141, name=volume-8acba91a-a498-4360-be96-f391b32be3bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb 1073741824" returned: 0 in 0.358s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] <== create_volume: return (517ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.529s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125f1a1d-44de-4076-824e-050cd3f66a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8acba91a-a498-4360-be96-f391b32be3bb', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49129eea-870d-43bb-9a94-09973d1c925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:03:59 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Volume volume-8acba91a-a498-4360-be96-f391b32be3bb (8acba91a-a498-4360-be96-f391b32be3bb): created successfully Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49129eea-870d-43bb-9a94-09973d1c925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:03:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Flow 'volume_create_manager' (05a1e81d-8b8c-4ae7-b9b1-e3034b05d863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:04:00 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-39ef577e-dc2e-431c-880b-9af79b0ad126 tempest-TestMinimumBasicScenario-1084006530 None] Created volume successfully. Sep 18 12:04:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-751fc7ed-d977-47f6-81cc-2a66fb5ff50e req-96e23fb9-8959-4d65-a49c-871f83968d04 tempest-TestMinimumBasicScenario-1084006530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:04:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-751fc7ed-d977-47f6-81cc-2a66fb5ff50e req-96e23fb9-8959-4d65-a49c-871f83968d04 tempest-TestMinimumBasicScenario-1084006530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:04:05 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1bc225-09d6-4b78-98dd-63426bc47aa6]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:04:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-751fc7ed-d977-47f6-81cc-2a66fb5ff50e req-96e23fb9-8959-4d65-a49c-871f83968d04 tempest-TestMinimumBasicScenario-1084006530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:04:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-751fc7ed-d977-47f6-81cc-2a66fb5ff50e req-96e23fb9-8959-4d65-a49c-871f83968d04 tempest-TestMinimumBasicScenario-1084006530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb" returned: 0 in 0.620s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:04:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-751fc7ed-d977-47f6-81cc-2a66fb5ff50e req-96e23fb9-8959-4d65-a49c-871f83968d04 tempest-TestMinimumBasicScenario-1084006530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.689s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:04:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-751fc7ed-d977-47f6-81cc-2a66fb5ff50e req-96e23fb9-8959-4d65-a49c-871f83968d04 tempest-TestMinimumBasicScenario-1084006530 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-8acba91a-a498-4360-be96-f391b32be3bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da68602c-eb02-40a5-9a51-09751d4700a9', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 12:04:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-751fc7ed-d977-47f6-81cc-2a66fb5ff50e req-96e23fb9-8959-4d65-a49c-871f83968d04 tempest-TestMinimumBasicScenario-1084006530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:04:06 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-751fc7ed-d977-47f6-81cc-2a66fb5ff50e req-96e23fb9-8959-4d65-a49c-871f83968d04 tempest-TestMinimumBasicScenario-1084006530 None] attachment_update completed successfully. Sep 18 12:04:16 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:04:16 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.090s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:04:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:05:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:05:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:06:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-c0e74c78-d264-4549-94b6-c02dd73de261 req-165e1f97-7434-46eb-9a36-999ab79786dd tempest-TestMinimumBasicScenario-1084006530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:06:37 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-c0e74c78-d264-4549-94b6-c02dd73de261 req-165e1f97-7434-46eb-9a36-999ab79786dd tempest-TestMinimumBasicScenario-1084006530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:06:37 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-c0e74c78-d264-4549-94b6-c02dd73de261 req-165e1f97-7434-46eb-9a36-999ab79786dd tempest-TestMinimumBasicScenario-1084006530 None] Terminate volume connection completed successfully. Sep 18 12:06:37 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-c0e74c78-d264-4549-94b6-c02dd73de261 req-165e1f97-7434-46eb-9a36-999ab79786dd tempest-TestMinimumBasicScenario-1084006530 None] Deleting attachment da68602c-eb02-40a5-9a51-09751d4700a9. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Acquiring lock "cinder-8acba91a-a498-4360-be96-f391b32be3bb-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Lock "cinder-8acba91a-a498-4360-be96-f391b32be3bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:06:40 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Acquiring lock "cinder-quobyte-8acba91a-a498-4360-be96-f391b32be3bb" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Lock "cinder-quobyte-8acba91a-a498-4360-be96-f391b32be3bb" acquired by "delete_volume" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd579a-33d1-4757-a4e3-c79e1f26ffc3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb" returned: 0 in 0.434s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8acba91a-a498-4360-be96-f391b32be3bb" returned: 0 in 0.098s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:06:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Lock "cinder-quobyte-8acba91a-a498-4360-be96-f391b32be3bb" released by "delete_volume" :: held 0.696s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Created reservations ['4aca1ba9-8422-497e-8c19-78785baf004d', '6ff4bc65-e616-4510-9464-3151f8647c0b', '23d892ac-54f9-41c9-8aea-5ea695262497', '996da97e-9b4e-46f3-babd-f14ca48d9518'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.089s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:06:41 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Deleted volume successfully. Sep 18 12:06:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-576c31ec-3329-4fa3-90f0-c49a5f6b354f tempest-TestMinimumBasicScenario-1084006530 None] Lock "cinder-8acba91a-a498-4360-be96-f391b32be3bb-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.211s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:06:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:06:51 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:INSERT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:06:51 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:07:25 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Flow 'volume_create_manager' (6f00d374-9c90-4b8c-853a-a8eddbd4e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b18e53-21b5-4b69-8484-c3a5a1ba14ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b18e53-21b5-4b69-8484-c3a5a1ba14ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-882150878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb1e731-7ffb-4425-a625-5bd0c226c36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff4e578bea64180b5211890b7e2c94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:07:25Z,use_quota=True,user_id='4082a3207f70424bbbf587e4bc870eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb78c32e-2a2f-40d8-9892-07cabe40a99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb78c32e-2a2f-40d8-9892-07cabe40a99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3b4835-3f71-42b4-84e9-cb5df4bad960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3b4835-3f71-42b4-84e9-cb5df4bad960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb1e731-7ffb-4425-a625-5bd0c226c36e', 'volume_name': 'volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca25d121-fdc8-42ce-8abb-47f699c3e1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca25d121-fdc8-42ce-8abb-47f699c3e1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0b1bad-46a8-43d1-bbbe-1cd8d9302559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:25 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume dfb1e731-7ffb-4425-a625-5bd0c226c36e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e', 'volume_size': 1} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-882150878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb1e731-7ffb-4425-a625-5bd0c226c36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff4e578bea64180b5211890b7e2c94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:07:25Z,use_quota=True,user_id='4082a3207f70424bbbf587e4bc870eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Creating volume dfb1e731-7ffb-4425-a625-5bd0c226c36e {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:07:25 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:07:25 devstack quobyte-client[83210]: System call of process 99190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:07:25 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=142, name=volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:07:25 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:07:25 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Flow 'volume_create_manager' (4486652e-dc21-43d4-bb84-03960a98ab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0e38d1-c090-4ebf-b31a-8a825bfa04fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0e38d1-c090-4ebf-b31a-8a825bfa04fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1537119027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55789c0-6347-480b-ae3b-7ed07eed04c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff4e578bea64180b5211890b7e2c94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:07:25Z,use_quota=True,user_id='4082a3207f70424bbbf587e4bc870eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a41f750-92d5-484a-beb1-ae3f532c1125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a41f750-92d5-484a-beb1-ae3f532c1125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3266183e-61c6-455c-a03b-e85eb08aa1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3266183e-61c6-455c-a03b-e85eb08aa1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd55789c0-6347-480b-ae3b-7ed07eed04c4', 'volume_name': 'volume-d55789c0-6347-480b-ae3b-7ed07eed04c4', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0d85f3-b74a-4031-8ad3-51c3a3e66276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0d85f3-b74a-4031-8ad3-51c3a3e66276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34c2579-95db-464b-a2cc-20902666e48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:26 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume d55789c0-6347-480b-ae3b-7ed07eed04c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d55789c0-6347-480b-ae3b-7ed07eed04c4', 'volume_size': 1} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e 1073741824" returned: 0 in 0.716s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e" returned: 0 in 0.130s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] <== create_volume: return (899ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1537119027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55789c0-6347-480b-ae3b-7ed07eed04c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff4e578bea64180b5211890b7e2c94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:07:25Z,use_quota=True,user_id='4082a3207f70424bbbf587e4bc870eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Creating volume d55789c0-6347-480b-ae3b-7ed07eed04c4 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:07:26 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:07:26 devstack quobyte-client[83210]: System call of process 99194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:07:26 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=143, name=volume-d55789c0-6347-480b-ae3b-7ed07eed04c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0b1bad-46a8-43d1-bbbe-1cd8d9302559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0fe0d8-b169-4b9f-8e27-53e738042471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4 1073741824" returned: 0 in 0.411s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:07:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:07:27 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e (dfb1e731-7ffb-4425-a625-5bd0c226c36e): created successfully Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0fe0d8-b169-4b9f-8e27-53e738042471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Flow 'volume_create_manager' (6f00d374-9c90-4b8c-853a-a8eddbd4e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4" returned: 0 in 0.280s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] <== create_volume: return (716ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34c2579-95db-464b-a2cc-20902666e48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55789c0-6347-480b-ae3b-7ed07eed04c4', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b268515f-d121-4fe2-9c62-66493790442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:07:27 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-938e2730-d450-4fcc-ab21-9ef4458ce857 tempest-TestServerVolumeAttachmentScenario-123807246 None] Created volume successfully. Sep 18 12:07:27 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume volume-d55789c0-6347-480b-ae3b-7ed07eed04c4 (d55789c0-6347-480b-ae3b-7ed07eed04c4): created successfully Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b268515f-d121-4fe2-9c62-66493790442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:07:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Flow 'volume_create_manager' (4486652e-dc21-43d4-bb84-03960a98ab2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:07:27 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-334ed8c6-8193-4632-92a3-23f358b9af9a tempest-TestServerVolumeAttachmentScenario-123807246 None] Created volume successfully. Sep 18 12:07:37 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:07:37 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:07:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:07:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:07:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.086s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:07:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:07:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:07:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.175s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:07:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:07:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.267s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:07:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:07:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.094s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:08:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:09:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-28f68a03-6d3c-466c-8933-97ed58eab0a6 req-3f55d96a-7842-44b8-927d-ccaa07a07522 tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:09:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-28f68a03-6d3c-466c-8933-97ed58eab0a6 req-3f55d96a-7842-44b8-927d-ccaa07a07522 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:09:00 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2ec404-c246-4d82-bd10-afe33a988e6c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:09:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-28f68a03-6d3c-466c-8933-97ed58eab0a6 req-3f55d96a-7842-44b8-927d-ccaa07a07522 tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:09:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-28f68a03-6d3c-466c-8933-97ed58eab0a6 req-3f55d96a-7842-44b8-927d-ccaa07a07522 tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e" returned: 0 in 0.466s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:09:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-28f68a03-6d3c-466c-8933-97ed58eab0a6 req-3f55d96a-7842-44b8-927d-ccaa07a07522 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.533s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:09:01 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-28f68a03-6d3c-466c-8933-97ed58eab0a6 req-3f55d96a-7842-44b8-927d-ccaa07a07522 tempest-TestServerVolumeAttachmentScenario-123807246 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84c75547-8bf2-4ae5-9d5f-16b945fdce0a', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 12:09:01 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-28f68a03-6d3c-466c-8933-97ed58eab0a6 req-3f55d96a-7842-44b8-927d-ccaa07a07522 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:09:01 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-28f68a03-6d3c-466c-8933-97ed58eab0a6 req-3f55d96a-7842-44b8-927d-ccaa07a07522 tempest-TestServerVolumeAttachmentScenario-123807246 None] attachment_update completed successfully. Sep 18 12:09:11 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:09:11 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=7 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:09:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-cd44c53d-f9e3-4e6f-92d9-d95f2e333012 req-14036819-5dc1-46a0-863c-ee86a218d979 tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:09:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-cd44c53d-f9e3-4e6f-92d9-d95f2e333012 req-14036819-5dc1-46a0-863c-ee86a218d979 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:09:14 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbdec43-2f45-4a8c-993a-3917e1292bba]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:09:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-cd44c53d-f9e3-4e6f-92d9-d95f2e333012 req-14036819-5dc1-46a0-863c-ee86a218d979 tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:09:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-cd44c53d-f9e3-4e6f-92d9-d95f2e333012 req-14036819-5dc1-46a0-863c-ee86a218d979 tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4" returned: 0 in 0.386s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:09:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-cd44c53d-f9e3-4e6f-92d9-d95f2e333012 req-14036819-5dc1-46a0-863c-ee86a218d979 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.438s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:09:14 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-cd44c53d-f9e3-4e6f-92d9-d95f2e333012 req-14036819-5dc1-46a0-863c-ee86a218d979 tempest-TestServerVolumeAttachmentScenario-123807246 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-d55789c0-6347-480b-ae3b-7ed07eed04c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd626956-db45-4938-b495-fd60452e68f8', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 12:09:14 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-cd44c53d-f9e3-4e6f-92d9-d95f2e333012 req-14036819-5dc1-46a0-863c-ee86a218d979 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:09:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-cd44c53d-f9e3-4e6f-92d9-d95f2e333012 req-14036819-5dc1-46a0-863c-ee86a218d979 tempest-TestServerVolumeAttachmentScenario-123807246 None] attachment_update completed successfully. Sep 18 12:09:25 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:09:25 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:09:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-5353699a-0d4d-4750-8bcf-e56fa372883a req-c16893cd-ab24-49aa-9cc3-703cd8573647 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:09:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-5353699a-0d4d-4750-8bcf-e56fa372883a req-c16893cd-ab24-49aa-9cc3-703cd8573647 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:09:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-5353699a-0d4d-4750-8bcf-e56fa372883a req-c16893cd-ab24-49aa-9cc3-703cd8573647 tempest-TestServerVolumeAttachmentScenario-123807246 None] Terminate volume connection completed successfully. Sep 18 12:09:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-5353699a-0d4d-4750-8bcf-e56fa372883a req-c16893cd-ab24-49aa-9cc3-703cd8573647 tempest-TestServerVolumeAttachmentScenario-123807246 None] Deleting attachment dd626956-db45-4938-b495-fd60452e68f8. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.111s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:09:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:09:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:09:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:10:06 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-98c360aa-c69b-4f96-b006-703ff43da9c0 req-325d3228-9b13-48c5-86b7-6e97987b50c5 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:10:06 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-98c360aa-c69b-4f96-b006-703ff43da9c0 req-325d3228-9b13-48c5-86b7-6e97987b50c5 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:10:06 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-98c360aa-c69b-4f96-b006-703ff43da9c0 req-325d3228-9b13-48c5-86b7-6e97987b50c5 tempest-TestServerVolumeAttachmentScenario-123807246 None] Terminate volume connection completed successfully. Sep 18 12:10:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-98c360aa-c69b-4f96-b006-703ff43da9c0 req-325d3228-9b13-48c5-86b7-6e97987b50c5 tempest-TestServerVolumeAttachmentScenario-123807246 None] Deleting attachment 84c75547-8bf2-4ae5-9d5f-16b945fdce0a. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 12:10:16 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:10:16 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:10:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "cinder-d55789c0-6347-480b-ae3b-7ed07eed04c4-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:10:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "cinder-d55789c0-6347-480b-ae3b-7ed07eed04c4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:10:18 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:10:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "cinder-quobyte-d55789c0-6347-480b-ae3b-7ed07eed04c4" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:10:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "cinder-quobyte-d55789c0-6347-480b-ae3b-7ed07eed04c4" acquired by "delete_volume" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:10:18 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[603bc339-9b6c-4519-90c0-8e5578eb7baf]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:10:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:10:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4" returned: 0 in 0.396s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:10:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-d55789c0-6347-480b-ae3b-7ed07eed04c4" returned: 0 in 0.092s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "cinder-quobyte-d55789c0-6347-480b-ae3b-7ed07eed04c4" released by "delete_volume" :: held 0.621s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Created reservations ['ab947410-3be9-46d1-9a12-161f750cd3c8', '457a7a1e-906c-4269-a8d9-0964d8572a89', '1f5470a9-0f6d-4497-9b1d-74c2d3a372f1', '681b7566-8975-43f3-82ac-7d0906c18b96'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.115s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:10:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Deleted volume successfully. Sep 18 12:10:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "cinder-dfb1e731-7ffb-4425-a625-5bd0c226c36e-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "cinder-dfb1e731-7ffb-4425-a625-5bd0c226c36e-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2623c2ba-cb1c-4d6f-9faf-a85c526aa840 tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "cinder-d55789c0-6347-480b-ae3b-7ed07eed04c4-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:10:20 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "cinder-quobyte-dfb1e731-7ffb-4425-a625-5bd0c226c36e" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "cinder-quobyte-dfb1e731-7ffb-4425-a625-5bd0c226c36e" acquired by "delete_volume" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd14b3be-8da6-4251-9948-61e8e95e59e8]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e" returned: 0 in 0.475s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-dfb1e731-7ffb-4425-a625-5bd0c226c36e" returned: 0 in 0.090s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:10:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "cinder-quobyte-dfb1e731-7ffb-4425-a625-5bd0c226c36e" released by "delete_volume" :: held 0.771s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Created reservations ['44d62ec8-9286-470d-b0dd-14329b2d6f11', '8c7ebabe-78df-4f15-90e8-3258d02d767c', '7b3d92c2-45dc-4a38-8e45-37d63e0748a1', '86414947-7c02-40e8-8037-cc428688aa0d'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.111s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:10:21 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Deleted volume successfully. Sep 18 12:10:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84b19723-da7f-429b-8eef-6185de25f86a tempest-TestServerVolumeAttachmentScenario-123807246 None] Lock "cinder-dfb1e731-7ffb-4425-a625-5bd0c226c36e-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:10:31 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:10:31 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=17,cinder:SELECT=10,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.120s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:10:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:10:58 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:10:58 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:10:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Flow 'volume_create_manager' (73ac4760-f603-44d1-8ada-ea64b627f40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:10:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f8c691-b6a4-4cd1-b92d-943eaefafd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:10:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f8c691-b6a4-4cd1-b92d-943eaefafd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1374644329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffc0298-f8bf-4102-8d06-e46359ece3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88eb9dd4fd0742b6ab1457c7da5a3fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:10:59Z,use_quota=True,user_id='96698be42f7841f8bc3e548c0b1f80ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:10:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa830f07-1261-4a17-b969-ae342b024845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:10:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa830f07-1261-4a17-b969-ae342b024845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:10:58 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d3274e-19b1-469f-b80e-6e3b4e831d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:10:58 devstack cinder-volume[83184]: DEBUG cinder.image.glance [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Creating Keystone auth plugin from conf {{(pid=83184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 18 12:10:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d3274e-19b1-469f-b80e-6e3b4e831d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ffc0298-f8bf-4102-8d06-e46359ece3d8', 'volume_name': 'volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:10:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695c54b5-63ae-40eb-ae8f-0790c8db6764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:10:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695c54b5-63ae-40eb-ae8f-0790c8db6764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:10:59 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29edb9d9-1392-4e16-9150-6849d051859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:10:59 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Volume 0ffc0298-f8bf-4102-8d06-e46359ece3d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 12:10:59 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Cloning 0ffc0298-f8bf-4102-8d06-e46359ece3d8 from image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]). {{(pid=83184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 18 12:10:59 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 18 12:10:59 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Image download 20.69 MB at 20.69 MB/s Sep 18 12:10:59 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[281851a4-ccd0-4f7a-94c0-cd4d1aa4cada]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:10:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:00 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD Sep 18 12:11:00 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:11:01 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 18 12:11:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD" returned: 0 in 2.023s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:01 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Temporary image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 is fetched for user 96698be42f7841f8bc3e548c0b1f80ec. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 18 12:11:02 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1874d40-9f15-4bd4-960d-9730675e6716]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:11:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:02 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD Sep 18 12:11:02 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:11:04 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD" returned: 0 in 1.952s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1374644329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffc0298-f8bf-4102-8d06-e46359ece3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88eb9dd4fd0742b6ab1457c7da5a3fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:10:59Z,use_quota=True,user_id='96698be42f7841f8bc3e548c0b1f80ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Creating volume 0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:11:04 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:04 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=144, name=volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 1073741824" returned: 0 in 0.302s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 0 in 0.082s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] <== create_volume: return (469ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.499s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:11:04 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Attempting download of 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}])) to volume 0ffc0298-f8bf-4102-8d06-e46359ece3d8. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 18 12:11:05 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fa15f1-4e4c-4473-bfeb-b3464c311760]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:11:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_y7qx60_l {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_y7qx60_l" returned: 0 in 0.352s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_y7qx60_l {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_y7qx60_l" returned: 1 in 0.335s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_y7qx60_l' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:11:05 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0204564e-f438-4b5f-9a70-033c58338c10]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:11:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:06 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 was qcow2, converting to raw {{(pid=83184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 18 12:11:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:06 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=144, name=volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:11:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 0 in 1.027s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:07 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea4d63f-7e24-4df1-821c-a0f7f4be0c51_i0r97c27devstack@QuobyteHD, size 112.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 12:11:07 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Converted 112.00 MB image at 106.46 MB/s Sep 18 12:11:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 1G" returned: 0 in 0.122s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:07 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcaa772-e9ce-45ba-ae7f-4a3c6c323e28]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:11:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 0 in 0.342s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 1 in 0.348s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Downloaded image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}])) to volume 0ffc0298-f8bf-4102-8d06-e46359ece3d8 successfully. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Temporary image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 for user 96698be42f7841f8bc3e548c0b1f80ec is deleted. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Marking volume 0ffc0298-f8bf-4102-8d06-e46359ece3d8 as bootable. {{(pid=83184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Copying metadata from image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 to 0ffc0298-f8bf-4102-8d06-e46359ece3d8. {{(pid=83184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Creating volume glance metadata for volume 0ffc0298-f8bf-4102-8d06-e46359ece3d8 backed by image 0ea4d63f-7e24-4df1-821c-a0f7f4be0c51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29edb9d9-1392-4e16-9150-6849d051859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8', 'volume_size': 1, 'image_id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '38b80ea2f7ae4ac6af2b63302295c6ae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea4d63f-7e24-4df1-821c-a0f7f4be0c51', 'created_at': datetime.datetime(2025, 9, 18, 9, 17, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 9, 17, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea4d63f-7e24-4df1-821c-a0f7f4be0c51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8338718f-f2f1-4b46-afc4-b9cdaf50f14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:11:08 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Volume volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 (0ffc0298-f8bf-4102-8d06-e46359ece3d8): created successfully Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8338718f-f2f1-4b46-afc4-b9cdaf50f14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:11:08 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Flow 'volume_create_manager' (73ac4760-f603-44d1-8ada-ea64b627f40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:11:08 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7ff76ccd-3175-4772-a785-e84953740516 tempest-TestShelveInstance-1124903765 None] Created volume successfully. Sep 18 12:11:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:11:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:11:18 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf23f4b-567b-4e85-b6d4-bf1c2c42b891]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:11:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 0 in 0.403s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 1 in 0.429s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:11:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.952s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:11:19 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71d3710a-6f8d-4556-8de1-1f4ce5c3a842', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 12:11:19 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:11:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-12545a4e-2554-4be2-b67d-abe80b6486f6 req-b54bbe99-9a65-4b42-897a-0aa0e66bb0fa tempest-TestShelveInstance-1124903765 None] attachment_update completed successfully. Sep 18 12:11:29 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=7 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:11:29 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.099s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:11:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:11:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:11:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.098s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:12:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:12:48 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-d3581168-e1c1-429c-81c2-ba800a854a66 req-ef187009-4a5e-481b-84ee-bc7ef31cb905 tempest-TestShelveInstance-1124903765 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:12:48 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-d3581168-e1c1-429c-81c2-ba800a854a66 req-ef187009-4a5e-481b-84ee-bc7ef31cb905 tempest-TestShelveInstance-1124903765 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:12:48 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-d3581168-e1c1-429c-81c2-ba800a854a66 req-ef187009-4a5e-481b-84ee-bc7ef31cb905 tempest-TestShelveInstance-1124903765 None] Terminate volume connection completed successfully. Sep 18 12:12:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-d3581168-e1c1-429c-81c2-ba800a854a66 req-ef187009-4a5e-481b-84ee-bc7ef31cb905 tempest-TestShelveInstance-1124903765 None] Deleting attachment 71d3710a-6f8d-4556-8de1-1f4ce5c3a842. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 12:12:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:12:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:12:55 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb6fe7c-0c03-431e-a28c-a784a6c9acf1]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:12:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:12:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 0 in 0.414s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:12:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:12:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 1 in 0.370s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:12:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:12:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:12:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d', 'name': 'volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50f5c1a3-9060-43ae-b6c0-3a9e5fa40653', 'enforce_multipath': True} {{(pid=83184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 18 12:12:56 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:12:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-81146621-0e92-4f9b-a3a7-be5c2e788bc1 req-eeaf471b-758f-4ce4-bf37-df290b9f2b85 tempest-TestShelveInstance-1124903765 None] attachment_update completed successfully. Sep 18 12:13:06 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:13:06 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.105s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:13:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:13:56 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:14:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-7ce05f9f-7d1a-438a-ad02-1652158e416d tempest-TestShelveInstance-1124903765 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:14:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-7ce05f9f-7d1a-438a-ad02-1652158e416d tempest-TestShelveInstance-1124903765 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:14:27 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-7ce05f9f-7d1a-438a-ad02-1652158e416d tempest-TestShelveInstance-1124903765 None] Terminate volume connection completed successfully. Sep 18 12:14:27 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-7ce05f9f-7d1a-438a-ad02-1652158e416d tempest-TestShelveInstance-1124903765 None] Deleting attachment 50f5c1a3-9060-43ae-b6c0-3a9e5fa40653. {{(pid=83184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 18 12:14:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Acquiring lock "cinder-0ffc0298-f8bf-4102-8d06-e46359ece3d8-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:14:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Lock "cinder-0ffc0298-f8bf-4102-8d06-e46359ece3d8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:14:28 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:14:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Acquiring lock "cinder-quobyte-0ffc0298-f8bf-4102-8d06-e46359ece3d8" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:14:28 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Lock "cinder-quobyte-0ffc0298-f8bf-4102-8d06-e46359ece3d8" acquired by "delete_volume" :: waited 0.012s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:14:28 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b65803-9c9a-4514-897c-ff17fad49b8e]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:14:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 0 in 0.405s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:14:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 1 in 0.413s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:14:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:14:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffc0298-f8bf-4102-8d06-e46359ece3d8" returned: 0 in 0.098s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:14:29 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Lock "cinder-quobyte-0ffc0298-f8bf-4102-8d06-e46359ece3d8" released by "delete_volume" :: held 1.230s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG cinder.quota [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Created reservations ['0a9bffe4-c7a9-4d88-9f27-d59fe69c0bb2', 'e6efff74-dcc0-4b63-a125-5ed9634adff9', '97b13c1e-4b4c-4541-9ea8-841585fc2081', '03a7836d-ec10-4f79-841f-5ab90a763262'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.090s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG cinder.manager [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:14:30 devstack cinder-volume[83184]: INFO cinder.volume.manager [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Deleted volume successfully. Sep 18 12:14:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [req-09c66f18-cb2c-410a-b547-baeb0d9df941 req-c6e648e0-c5d1-4c16-b411-46c1ebe7705e tempest-TestShelveInstance-1124903765 None] Lock "cinder-0ffc0298-f8bf-4102-8d06-e46359ece3d8-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:14:40 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:14:40 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.098s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:14:44 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:14:52 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:14:52 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:14:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Flow 'volume_create_manager' (d347e477-8cc9-45a4-9120-8276e100ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:14:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05796ea6-4b0d-4bff-8097-c03885c55e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05796ea6-4b0d-4bff-8097-c03885c55e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9269e296-9bbd-4bcf-be11-22ec94c0c985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504a3edcaf8e450aa8d6b8deb8149cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:53Z,use_quota=True,user_id='b1631ff97d2d4d85b9306c768f77c2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02f0b0f-3b62-453b-b2f9-8f3274b955cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02f0b0f-3b62-453b-b2f9-8f3274b955cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba7ac87-724c-491a-811f-32d062009e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.image.glance [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Creating Keystone auth plugin from conf {{(pid=83184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba7ac87-724c-491a-811f-32d062009e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9269e296-9bbd-4bcf-be11-22ec94c0c985', 'volume_name': 'volume-9269e296-9bbd-4bcf-be11-22ec94c0c985', 'volume_size': 1, 'image_id': '0236ce42-b6c7-41eb-bc93-7d861b978809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0236ce42-b6c7-41eb-bc93-7d861b978809', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7a092f8000f1d5afd2127ead3431222b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '504a3edcaf8e450aa8d6b8deb8149cd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc8a88f8388c284fe241d0eb828a0415b4475c60d08a31d2cce2f2e909bc912f8160c82c384174e1e74d240a6a654c666668341e054d883656f5241d057a4f52', 'id': '0236ce42-b6c7-41eb-bc93-7d861b978809', 'created_at': datetime.datetime(2025, 9, 18, 10, 14, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 14, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0236ce42-b6c7-41eb-bc93-7d861b978809/file', 'properties': {}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f9cffe-8e66-41e3-b3a8-f93d9da8357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f9cffe-8e66-41e3-b3a8-f93d9da8357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bc3d26-2ec0-4939-afa1-880851ef4719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:14:53 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Volume 9269e296-9bbd-4bcf-be11-22ec94c0c985: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9269e296-9bbd-4bcf-be11-22ec94c0c985', 'volume_size': 1, 'image_id': '0236ce42-b6c7-41eb-bc93-7d861b978809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0236ce42-b6c7-41eb-bc93-7d861b978809', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7a092f8000f1d5afd2127ead3431222b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '504a3edcaf8e450aa8d6b8deb8149cd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc8a88f8388c284fe241d0eb828a0415b4475c60d08a31d2cce2f2e909bc912f8160c82c384174e1e74d240a6a654c666668341e054d883656f5241d057a4f52', 'id': '0236ce42-b6c7-41eb-bc93-7d861b978809', 'created_at': datetime.datetime(2025, 9, 18, 10, 14, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 14, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0236ce42-b6c7-41eb-bc93-7d861b978809/file', 'properties': {}}, 'image_service': } Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Cloning 9269e296-9bbd-4bcf-be11-22ec94c0c985 from image 0236ce42-b6c7-41eb-bc93-7d861b978809 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0236ce42-b6c7-41eb-bc93-7d861b978809', 'metadata': {}}]). {{(pid=83184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 18 12:14:53 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Image download 0.00 MB at 0.00 MB/s Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da51370-fc16-414f-9348-0765fe84d521]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:14:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:53 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD Sep 18 12:14:53 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:14:55 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 18 12:14:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD" returned: 0 in 1.933s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:14:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:55 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD Sep 18 12:14:55 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:14:57 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 18 12:14:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD" returned: 1 in 1.861s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:14:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:14:57 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Temporary image 0236ce42-b6c7-41eb-bc93-7d861b978809 is fetched for user b1631ff97d2d4d85b9306c768f77c2af. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 18 12:14:57 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a7b51-cfa5-426f-979f-e5a17cd8a8b5]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:14:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:57 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD Sep 18 12:14:57 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:14:59 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 18 12:14:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD" returned: 0 in 1.969s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:14:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:14:59 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD Sep 18 12:14:59 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:15:01 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD" returned: 1 in 2.199s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9269e296-9bbd-4bcf-be11-22ec94c0c985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504a3edcaf8e450aa8d6b8deb8149cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:14:53Z,use_quota=True,user_id='b1631ff97d2d4d85b9306c768f77c2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Creating volume 9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:01 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:01 devstack quobyte-client[83210]: System call of process 101538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:01 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=145, name=volume-9269e296-9bbd-4bcf-be11-22ec94c0c985, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 1073741824" returned: 0 in 0.302s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985" returned: 0 in 0.078s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] <== create_volume: return (465ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.491s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Attempting download of 0236ce42-b6c7-41eb-bc93-7d861b978809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0236ce42-b6c7-41eb-bc93-7d861b978809', 'metadata': {}}])) to volume 9269e296-9bbd-4bcf-be11-22ec94c0c985. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fb0850-a9a2-4cb4-8be1-09a1833982f5]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0236ce42-b6c7-41eb-bc93-7d861b978809_f2e_1kk5 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0236ce42-b6c7-41eb-bc93-7d861b978809_f2e_1kk5" returned: 0 in 0.342s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0236ce42-b6c7-41eb-bc93-7d861b978809_f2e_1kk5 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0236ce42-b6c7-41eb-bc93-7d861b978809_f2e_1kk5" returned: 1 in 0.339s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0236ce42-b6c7-41eb-bc93-7d861b978809_f2e_1kk5' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:15:03 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd9ee1f-97c9-496a-9cf5-744ec39593c9]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] 0236ce42-b6c7-41eb-bc93-7d861b978809 was raw, converting to raw {{(pid=83184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:04 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=145, name=volume-9269e296-9bbd-4bcf-be11-22ec94c0c985, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985" returned: 0 in 0.158s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0236ce42-b6c7-41eb-bc93-7d861b978809_04vulue_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 12:15:04 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:04 devstack quobyte-client[83210]: System call of process 101560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 1G" returned: 0 in 0.135s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c25267a-3124-4ed6-8729-8b81b84303ca]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985" returned: 0 in 0.347s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985" returned: 1 in 0.338s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Downloaded image 0236ce42-b6c7-41eb-bc93-7d861b978809 ((None, [{'url': 'file:///opt/stack/data/glance/images/0236ce42-b6c7-41eb-bc93-7d861b978809', 'metadata': {}}])) to volume 9269e296-9bbd-4bcf-be11-22ec94c0c985 successfully. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Temporary image 0236ce42-b6c7-41eb-bc93-7d861b978809 for user b1631ff97d2d4d85b9306c768f77c2af is deleted. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Marking volume 9269e296-9bbd-4bcf-be11-22ec94c0c985 as bootable. {{(pid=83184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Copying metadata from image 0236ce42-b6c7-41eb-bc93-7d861b978809 to 9269e296-9bbd-4bcf-be11-22ec94c0c985. {{(pid=83184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Creating volume glance metadata for volume 9269e296-9bbd-4bcf-be11-22ec94c0c985 backed by image 0236ce42-b6c7-41eb-bc93-7d861b978809 with: {'image_id': '0236ce42-b6c7-41eb-bc93-7d861b978809', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7a092f8000f1d5afd2127ead3431222b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bc3d26-2ec0-4939-afa1-880851ef4719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9269e296-9bbd-4bcf-be11-22ec94c0c985', 'volume_size': 1, 'image_id': '0236ce42-b6c7-41eb-bc93-7d861b978809', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0236ce42-b6c7-41eb-bc93-7d861b978809', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7a092f8000f1d5afd2127ead3431222b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '504a3edcaf8e450aa8d6b8deb8149cd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc8a88f8388c284fe241d0eb828a0415b4475c60d08a31d2cce2f2e909bc912f8160c82c384174e1e74d240a6a654c666668341e054d883656f5241d057a4f52', 'id': '0236ce42-b6c7-41eb-bc93-7d861b978809', 'created_at': datetime.datetime(2025, 9, 18, 10, 14, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 14, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0236ce42-b6c7-41eb-bc93-7d861b978809/file', 'properties': {}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b10fdb-157c-468d-a3dd-ec746e0a49ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:05 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Volume volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 (9269e296-9bbd-4bcf-be11-22ec94c0c985): created successfully Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b10fdb-157c-468d-a3dd-ec746e0a49ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:05 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Flow 'volume_create_manager' (d347e477-8cc9-45a4-9120-8276e100ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-53dc7d36-aa54-4963-b829-b55c0d99b459 tempest-VolumeImageDependencyTests-14715913 None] Created volume successfully. Sep 18 12:15:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Acquiring lock "cinder-9269e296-9bbd-4bcf-be11-22ec94c0c985-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Lock "cinder-9269e296-9bbd-4bcf-be11-22ec94c0c985-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:06 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Acquiring lock "cinder-quobyte-9269e296-9bbd-4bcf-be11-22ec94c0c985" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Lock "cinder-quobyte-9269e296-9bbd-4bcf-be11-22ec94c0c985" acquired by "delete_volume" :: waited 0.010s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:07 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb2b1ca-11f2-45cb-8c37-f85b51f7953a]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985" returned: 0 in 0.365s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985" returned: 1 in 0.362s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:15:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-9269e296-9bbd-4bcf-be11-22ec94c0c985" returned: 0 in 0.084s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Lock "cinder-quobyte-9269e296-9bbd-4bcf-be11-22ec94c0c985" released by "delete_volume" :: held 1.018s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Created reservations ['4e7854ae-ed56-4431-97c9-198f75db457f', '0d1074c8-d0d3-4d5f-8fd8-becd18d9e480', '5dfd290e-26df-48fa-9fb8-8f581f065653', 'fd261c68-698e-455c-a750-3b26d54178e7'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.083s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:15:08 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Deleted volume successfully. Sep 18 12:15:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3a8dac10-45a4-4a02-a2bd-ce6ddb84f65b tempest-VolumeImageDependencyTests-14715913 None] Lock "cinder-9269e296-9bbd-4bcf-be11-22ec94c0c985-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:18 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10,cinder:INSERT=11,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:15:18 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:15:28 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (a29197e8-e588-4023-b182-aefb3518a2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e227e24-8dc4-44f9-9992-36976fd91730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e227e24-8dc4-44f9-9992-36976fd91730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396005640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f391d8-a242-4535-a9dd-2de7676fb623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:28Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1bac43-5579-4e78-a414-58695891f597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1bac43-5579-4e78-a414-58695891f597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1436bfb-4050-4262-a2bd-267a666f20c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1436bfb-4050-4262-a2bd-267a666f20c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f391d8-a242-4535-a9dd-2de7676fb623', 'volume_name': 'volume-b2f391d8-a242-4535-a9dd-2de7676fb623', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610347cf-3af6-4ea0-bb71-abd54add99b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610347cf-3af6-4ea0-bb71-abd54add99b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fe0d91-1983-4d31-90cd-d94be4148e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:28 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume b2f391d8-a242-4535-a9dd-2de7676fb623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f391d8-a242-4535-a9dd-2de7676fb623', 'volume_size': 1} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396005640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f391d8-a242-4535-a9dd-2de7676fb623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:28Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Creating volume b2f391d8-a242-4535-a9dd-2de7676fb623 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:28 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:28 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=146, name=volume-b2f391d8-a242-4535-a9dd-2de7676fb623, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 1073741824" returned: 0 in 0.621s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:29 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:29 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (d22e5ef9-185c-4f76-bdbd-4af9d7d78d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8423975-78b2-4477-bb2b-1cc55d413aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:29 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:29 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (42400379-eb41-44d7-afe9-f3230086f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:29 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b65ae6-1035-4cd4-82c5-81dfb22d35f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8423975-78b2-4477-bb2b-1cc55d413aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264370222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b176bbce-f24b-4aff-be28-2a4230f6f58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:29Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6236ebed-c97b-43e4-967b-d56537d34792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6236ebed-c97b-43e4-967b-d56537d34792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8d2780-71c1-4dc8-92ea-c57174074f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8d2780-71c1-4dc8-92ea-c57174074f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b176bbce-f24b-4aff-be28-2a4230f6f58b', 'volume_name': 'volume-b176bbce-f24b-4aff-be28-2a4230f6f58b', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e6fd7e-70ab-4380-aec1-9f6243161ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e6fd7e-70ab-4380-aec1-9f6243161ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7595d6ea-6cd2-4f85-ba03-262c54c135f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Volume b176bbce-f24b-4aff-be28-2a4230f6f58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b176bbce-f24b-4aff-be28-2a4230f6f58b', 'volume_size': 1} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623" returned: 0 in 0.882s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b65ae6-1035-4cd4-82c5-81dfb22d35f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1494368973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8595a0e3-8e7b-40c2-ad5d-e277254a1983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:28Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adb62a0-67f4-4014-84c4-6974158df91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adb62a0-67f4-4014-84c4-6974158df91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b726bc-2056-4ada-ac43-a882a8e49ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b726bc-2056-4ada-ac43-a882a8e49ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8595a0e3-8e7b-40c2-ad5d-e277254a1983', 'volume_name': 'volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd69ea6-bd10-4c66-a9d0-b3ef07e9afad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd69ea6-bd10-4c66-a9d0-b3ef07e9afad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ecc0dd-1754-4ac0-9106-5c3cc137f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Volume 8595a0e3-8e7b-40c2-ad5d-e277254a1983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983', 'volume_size': 1} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:30 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (81c44f79-574b-4ced-b472-598e06eca5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7b54c5-0416-4d6e-841c-e2f396dbeba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] <== create_volume: return (1732ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.237s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1264370222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b176bbce-f24b-4aff-be28-2a4230f6f58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:29Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Creating volume b176bbce-f24b-4aff-be28-2a4230f6f58b {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:30 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b176bbce-f24b-4aff-be28-2a4230f6f58b 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:30 devstack quobyte-client[83210]: System call of process 101631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:30 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=147, name=volume-b176bbce-f24b-4aff-be28-2a4230f6f58b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:30 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7b54c5-0416-4d6e-841c-e2f396dbeba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-135087793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610e35db-2d49-4039-b403-b3c6b343369b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:30Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d85ac04-9106-43b0-bdc5-5e078dd330a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d85ac04-9106-43b0-bdc5-5e078dd330a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f070e9-bbf0-413c-b981-034e92a2afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f070e9-bbf0-413c-b981-034e92a2afd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610e35db-2d49-4039-b403-b3c6b343369b', 'volume_name': 'volume-610e35db-2d49-4039-b403-b3c6b343369b', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e7e6d4-34a4-4b40-8d83-48ad7be7d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e7e6d4-34a4-4b40-8d83-48ad7be7d67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426e6073-36e5-491d-8e79-321711be4cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:31 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Volume 610e35db-2d49-4039-b403-b3c6b343369b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610e35db-2d49-4039-b403-b3c6b343369b', 'volume_size': 1} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fe0d91-1983-4d31-90cd-d94be4148e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f391d8-a242-4535-a9dd-2de7676fb623', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd086085-c589-47dc-9801-9988aebbe6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b176bbce-f24b-4aff-be28-2a4230f6f58b 1073741824" returned: 0 in 0.717s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b176bbce-f24b-4aff-be28-2a4230f6f58b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:31 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume volume-b2f391d8-a242-4535-a9dd-2de7676fb623 (b2f391d8-a242-4535-a9dd-2de7676fb623): created successfully Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd086085-c589-47dc-9801-9988aebbe6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (a29197e8-e588-4023-b182-aefb3518a2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:31 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (6f48d519-691a-41b9-9b02-90a1b6d3468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac68c170-6c71-4a57-8768-986374a0daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:31 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (1a7371db-ddb4-4410-bb8d-fd9d1172f854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7081f2f-43aa-4c78-9eae-e63083061563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b176bbce-f24b-4aff-be28-2a4230f6f58b" returned: 0 in 0.608s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:31 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0962fb9d-021c-49f4-a628-2887ebc868be tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created volume successfully. Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] <== create_volume: return (1353ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1494368973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8595a0e3-8e7b-40c2-ad5d-e277254a1983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:28Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Creating volume 8595a0e3-8e7b-40c2-ad5d-e277254a1983 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:31 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:31 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:32 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=148, name=volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac68c170-6c71-4a57-8768-986374a0daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-312434541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df72e4e3-c90b-4b21-9ec2-c298be9aa7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:30Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49a1810-adb0-4ff1-9213-718aaa95033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49a1810-adb0-4ff1-9213-718aaa95033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25286b29-a8e0-43a8-b34f-64161f8f2e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25286b29-a8e0-43a8-b34f-64161f8f2e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df72e4e3-c90b-4b21-9ec2-c298be9aa7ea', 'volume_name': 'volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663ccf86-173a-44df-ac0c-899b39632f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663ccf86-173a-44df-ac0c-899b39632f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4137bf44-1eb3-49b5-ba4a-b831d799dd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Volume df72e4e3-c90b-4b21-9ec2-c298be9aa7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea', 'volume_size': 1} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7081f2f-43aa-4c78-9eae-e63083061563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582131073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf0d8e4-2236-4475-ace1-be8660cc40ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:31Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dfb745-4fde-47ec-8cf2-a3b9743bcd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dfb745-4fde-47ec-8cf2-a3b9743bcd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8b5476-ae59-48ee-a1c7-d3c145ef58a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8b5476-ae59-48ee-a1c7-d3c145ef58a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf0d8e4-2236-4475-ace1-be8660cc40ac', 'volume_name': 'volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6c965e-231a-4871-b405-b4af1aa51fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6c965e-231a-4871-b405-b4af1aa51fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6704bf4b-2afe-4991-88f0-537688c2e543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Volume aaf0d8e4-2236-4475-ace1-be8660cc40ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac', 'volume_size': 1} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7595d6ea-6cd2-4f85-ba03-262c54c135f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b176bbce-f24b-4aff-be28-2a4230f6f58b', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95d865a-ba56-4f4d-9f15-9eb0ebe1f4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983 1073741824" returned: 0 in 0.715s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:32 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Volume volume-b176bbce-f24b-4aff-be28-2a4230f6f58b (b176bbce-f24b-4aff-be28-2a4230f6f58b): created successfully Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95d865a-ba56-4f4d-9f15-9eb0ebe1f4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (d22e5ef9-185c-4f76-bdbd-4af9d7d78d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983" returned: 0 in 0.406s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] <== create_volume: return (1150ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.846s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-135087793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610e35db-2d49-4039-b403-b3c6b343369b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:30Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Creating volume 610e35db-2d49-4039-b403-b3c6b343369b {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:32 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-610e35db-2d49-4039-b403-b3c6b343369b 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:33 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=149, name=volume-610e35db-2d49-4039-b403-b3c6b343369b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:33 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a36a257b-f6c7-4ea5-9555-79c60d88e319 tempest-CreateVolumesFromImageTest-611791259 None] Created volume successfully. Sep 18 12:15:33 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ecc0dd-1754-4ac0-9106-5c3cc137f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb303e56-92f4-430f-b89e-e2b42d369857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-610e35db-2d49-4039-b403-b3c6b343369b 1073741824" returned: 0 in 0.488s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-610e35db-2d49-4039-b403-b3c6b343369b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:33 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Volume volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983 (8595a0e3-8e7b-40c2-ad5d-e277254a1983): created successfully Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb303e56-92f4-430f-b89e-e2b42d369857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (42400379-eb41-44d7-afe9-f3230086f324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-610e35db-2d49-4039-b403-b3c6b343369b" returned: 0 in 0.343s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] <== create_volume: return (855ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.627s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-312434541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df72e4e3-c90b-4b21-9ec2-c298be9aa7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:30Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Creating volume df72e4e3-c90b-4b21-9ec2-c298be9aa7ea {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:33 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:34 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=150, name=volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:34 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3ad1e9cd-f8f7-49ae-9c22-d4dac49a11d1 tempest-CreateVolumesFromImageTest-611791259 None] Created volume successfully. Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426e6073-36e5-491d-8e79-321711be4cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610e35db-2d49-4039-b403-b3c6b343369b', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c1fc3d-adf8-457e-a621-cdf311dfa7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:34 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Volume volume-610e35db-2d49-4039-b403-b3c6b343369b (610e35db-2d49-4039-b403-b3c6b343369b): created successfully Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c1fc3d-adf8-457e-a621-cdf311dfa7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (81c44f79-574b-4ced-b472-598e06eca5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea 1073741824" returned: 0 in 0.547s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:34 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a7680221-89f6-4d27-85a0-9fde11db95d3 tempest-CreateVolumesFromImageTest-611791259 None] Created volume successfully. Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea" returned: 0 in 0.378s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] <== create_volume: return (950ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.430s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582131073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf0d8e4-2236-4475-ace1-be8660cc40ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f63f99198147248ad50c923e2c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:31Z,use_quota=True,user_id='5c7a0843c1c549b2910d922647aaafe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Creating volume aaf0d8e4-2236-4475-ace1-be8660cc40ac {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:34 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:34 devstack quobyte-client[83210]: System call of process 101648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:34 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=151, name=volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4137bf44-1eb3-49b5-ba4a-b831d799dd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cdad12-1c92-43a5-9584-739dd40361b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:35 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Volume volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea (df72e4e3-c90b-4b21-9ec2-c298be9aa7ea): created successfully Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cdad12-1c92-43a5-9584-739dd40361b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (6f48d519-691a-41b9-9b02-90a1b6d3468c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac 1073741824" returned: 0 in 0.466s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac" returned: 0 in 0.162s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] <== create_volume: return (674ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.252s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:35 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2c0cf2c2-0476-4e25-8ea5-c0bbf7f75cda tempest-CreateVolumesFromImageTest-611791259 None] Created volume successfully. Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6704bf4b-2afe-4991-88f0-537688c2e543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd7739c-4928-4b3b-a40b-d8f1190e30c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Creating offline snapshot 3a122259-a308-48f6-bf42-bbd08945904e of volume b2f391d8-a242-4535-a9dd-2de7676fb623 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62092e6f-8e2d-4dd3-a5e5-86091f155f0c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:35 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Volume volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac (aaf0d8e4-2236-4475-ace1-be8660cc40ac): created successfully Sep 18 12:15:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd7739c-4928-4b3b-a40b-d8f1190e30c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:36 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Flow 'volume_create_manager' (1a7371db-ddb4-4410-bb8d-fd9d1172f854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3bbcd955-180b-4b33-82c7-9968e1f588ab tempest-CreateVolumesFromImageTest-611791259 None] Created volume successfully. Sep 18 12:15:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623" returned: 0 in 0.725s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:36 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=152, name=volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e 1G" returned: 0 in 0.329s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b2f391d8-a242-4535-a9dd-2de7676fb623 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-aaf0d8e4-2236-4475-ace1-be8660cc40ac-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img rebase -u -b volume-b2f391d8-a242-4535-a9dd-2de7676fb623 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e" returned: 0 in 0.441s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-aaf0d8e4-2236-4475-ace1-be8660cc40ac-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:15:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e" returned: 0 in 0.379s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:37 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 12:15:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:38 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-quobyte-aaf0d8e4-2236-4475-ace1-be8660cc40ac" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e" returned: 0 in 0.523s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-aaf0d8e4-2236-4475-ace1-be8660cc40ac" acquired by "delete_volume" :: waited 0.252s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eca42dc-9d7b-45f7-b8db-39575f8384bb]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.info" returned: 0 in 0.430s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:15:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.info" returned: 0 in 0.187s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac" returned: 0 in 0.915s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:39 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-de89fd10-989a-4e0d-88db-2a4e259628e6 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Create snapshot completed successfully Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-aaf0d8e4-2236-4475-ace1-be8660cc40ac" returned: 0 in 0.386s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-aaf0d8e4-2236-4475-ace1-be8660cc40ac" released by "delete_volume" :: held 1.482s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Created reservations ['833020a8-3ed7-410a-8b11-c041e5fc50a1', 'c20d3d96-b5b5-43ab-ad03-09ed37fa363c', 'a6dd16c1-b6d5-4b23-bb53-64658623b649', '98468740-6d5a-4cab-836a-ff22e602dccb'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.204s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:40 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:15:40 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Deleted volume successfully. Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-e9d66cf9-55ab-487a-ac95-a782f5b96d74 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-aaf0d8e4-2236-4475-ace1-be8660cc40ac-delete_volume" released by "delete_volume" :: held 3.800s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea-delete_volume" acquired by "delete_volume" :: waited 0.197s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:41 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-quobyte-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:41 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (dfb34f4f-d04f-4927-832c-39672f5d0f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a964a7ed-17da-4ee6-8745-967b94c041e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea" acquired by "delete_volume" :: waited 0.246s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a964a7ed-17da-4ee6-8745-967b94c041e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-188865119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:41Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5baea9-b87e-4926-a36e-88ac1381822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5baea9-b87e-4926-a36e-88ac1381822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4127b736-9689-4e50-95db-86cc4a1d0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4127b736-9689-4e50-95db-86cc4a1d0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8', 'volume_name': 'volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d457e-01aa-4cf3-9ac2-e6c33162834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d457e-01aa-4cf3-9ac2-e6c33162834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e739610-7d5f-4efd-b317-fe307a576159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:41 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume 4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8', 'volume_size': 1} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-188865119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:41Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Creating volume 4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:41 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:41 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:42 devstack quobyte-client[83210]: System call of process 101672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:42 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=154, name=volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:42 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c9dba-e98f-458c-9eb8-6f7d673bba64]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:42 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:42 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (23c53446-8be0-4f94-97de-3024b7bd65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a716d1f-11b8-4555-af3d-c8e11b82873d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8 1073741824" returned: 0 in 1.223s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a716d1f-11b8-4555-af3d-c8e11b82873d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-619684237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea4a6ac-f9ab-478d-acce-2edea9fd6d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:42Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d72a69-23e5-4636-806b-9b68dd172f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d72a69-23e5-4636-806b-9b68dd172f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3824b8-8ae6-45b0-aa6d-e1d65e3d6cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3824b8-8ae6-45b0-aa6d-e1d65e3d6cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea4a6ac-f9ab-478d-acce-2edea9fd6d26', 'volume_name': 'volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243977fd-82e4-4e13-aa4c-83b51c9a0fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243977fd-82e4-4e13-aa4c-83b51c9a0fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65fa7c9-a6cd-4adf-b040-3a8a0010dd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:43 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume cea4a6ac-f9ab-478d-acce-2edea9fd6d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26', 'volume_size': 1} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:43 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:43 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (24e11916-0083-4b52-9b3d-6bd6f8df6777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08a98fe-fc7e-4a9d-877e-a7ddc3bbc39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea" returned: 0 in 1.599s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8" returned: 0 in 0.653s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:44 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (490f0f83-f196-4d47-b4e6-01c26d897db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b934c927-42cc-415d-8309-7bebba5ba30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] <== create_volume: return (2316ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.369s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-619684237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea4a6ac-f9ab-478d-acce-2edea9fd6d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:42Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Creating volume cea4a6ac-f9ab-478d-acce-2edea9fd6d26 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:44 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:44 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:15:44 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=155, name=volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (80988bd7-155f-4b28-bf88-5db3e4b11951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1becbd22-3abd-4a0d-9719-87b3a87ff7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08a98fe-fc7e-4a9d-877e-a7ddc3bbc39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255966997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5399b09a-cac4-47d8-b80e-407d7948cfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:42Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace697ee-e0ef-40d8-94ae-b01ed16b277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace697ee-e0ef-40d8-94ae-b01ed16b277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:44 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34843ee7-1605-4576-b786-95c1e725b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34843ee7-1605-4576-b786-95c1e725b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5399b09a-cac4-47d8-b80e-407d7948cfd7', 'volume_name': 'volume-5399b09a-cac4-47d8-b80e-407d7948cfd7', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97363dd-1cf8-49a1-892a-bec49e98aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97363dd-1cf8-49a1-892a-bec49e98aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb3a4ef-edd9-4ddc-9c6a-e907c885f244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume 5399b09a-cac4-47d8-b80e-407d7948cfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5399b09a-cac4-47d8-b80e-407d7948cfd7', 'volume_size': 1} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1becbd22-3abd-4a0d-9719-87b3a87ff7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1075755534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb5514a-4ec5-4384-b096-252aa0650bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:44Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3228c5b-0a61-4008-9f1e-7a05765cb1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3228c5b-0a61-4008-9f1e-7a05765cb1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11670fd-0f25-4fa6-a556-4c4947c49ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11670fd-0f25-4fa6-a556-4c4947c49ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb5514a-4ec5-4384-b096-252aa0650bcb', 'volume_name': 'volume-7eb5514a-4ec5-4384-b096-252aa0650bcb', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70298c0-415b-4b4d-97b7-9d1b50c1f2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70298c0-415b-4b4d-97b7-9d1b50c1f2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7699d66-da85-4c38-a3c7-3ed2bce60ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume 7eb5514a-4ec5-4384-b096-252aa0650bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb5514a-4ec5-4384-b096-252aa0650bcb', 'volume_size': 1} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e739610-7d5f-4efd-b317-fe307a576159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73426e3a-33c3-43fc-9284-9146527a6748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b934c927-42cc-415d-8309-7bebba5ba30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301946072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffedde8-bdeb-4df3-8658-8bb16a94e3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:43Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1607ab65-f597-416f-b474-a42fda71dba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1607ab65-f597-416f-b474-a42fda71dba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a05568-8080-4434-b043-220d85f0d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a05568-8080-4434-b043-220d85f0d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ffedde8-bdeb-4df3-8658-8bb16a94e3e6', 'volume_name': 'volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf432ce-1329-4706-b6be-5e9cca67023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf432ce-1329-4706-b6be-5e9cca67023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2ef1df-dad9-477c-b12b-1567d1b9e6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:45 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume 0ffedde8-bdeb-4df3-8658-8bb16a94e3e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6', 'volume_size': 1} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea" returned: 0 in 1.580s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:45 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8 (4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8): created successfully Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73426e3a-33c3-43fc-9284-9146527a6748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (dfb34f4f-d04f-4927-832c-39672f5d0f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:45 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ed09f92f-3e5e-4636-84d5-df5ff2eaae08 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created volume successfully. Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea" released by "delete_volume" :: held 4.003s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.690s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26 1073741824" returned: 0 in 1.300s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:15:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26" returned: 0 in 0.488s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] <== create_volume: return (1878ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.389s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255966997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5399b09a-cac4-47d8-b80e-407d7948cfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:42Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Creating volume 5399b09a-cac4-47d8-b80e-407d7948cfd7 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:46 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5399b09a-cac4-47d8-b80e-407d7948cfd7 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:46 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=156, name=volume-5399b09a-cac4-47d8-b80e-407d7948cfd7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:46 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65fa7c9-a6cd-4adf-b040-3a8a0010dd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d98bd43-e5bc-4960-a8ea-badb85aa9893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5399b09a-cac4-47d8-b80e-407d7948cfd7 1073741824" returned: 0 in 0.615s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5399b09a-cac4-47d8-b80e-407d7948cfd7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:47 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26 (cea4a6ac-f9ab-478d-acce-2edea9fd6d26): created successfully Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d98bd43-e5bc-4960-a8ea-badb85aa9893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (23c53446-8be0-4f94-97de-3024b7bd65dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5399b09a-cac4-47d8-b80e-407d7948cfd7" returned: 0 in 0.400s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] <== create_volume: return (1084ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.073s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1075755534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb5514a-4ec5-4384-b096-252aa0650bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:44Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Creating volume 7eb5514a-4ec5-4384-b096-252aa0650bcb {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:47 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7eb5514a-4ec5-4384-b096-252aa0650bcb 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:47 devstack quobyte-client[83210]: System call of process 101689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:47 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=157, name=volume-7eb5514a-4ec5-4384-b096-252aa0650bcb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb3a4ef-edd9-4ddc-9c6a-e907c885f244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5399b09a-cac4-47d8-b80e-407d7948cfd7', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566b3eae-2e61-427a-a9e4-7333a8309b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:48 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7158eaeb-aafd-4302-acd8-c3d02899255a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created volume successfully. Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Created reservations ['64d2585b-4610-4e85-b382-49b6ddf4d41d', '7c39b2fd-020f-4f67-ad4a-1d7b15f86084', '2f30670e-f553-47e2-93c9-b6bb34ba53f3', '4fe861d5-2f5d-4543-9398-129c13c2ad2f'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7eb5514a-4ec5-4384-b096-252aa0650bcb 1073741824" returned: 0 in 0.587s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7eb5514a-4ec5-4384-b096-252aa0650bcb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:48 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume volume-5399b09a-cac4-47d8-b80e-407d7948cfd7 (5399b09a-cac4-47d8-b80e-407d7948cfd7): created successfully Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566b3eae-2e61-427a-a9e4-7333a8309b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (24e11916-0083-4b52-9b3d-6bd6f8df6777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:48 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-7c04748d-1fd9-4504-9b46-494b99da7cbc tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created volume successfully. Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7eb5514a-4ec5-4384-b096-252aa0650bcb" returned: 0 in 0.464s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] <== create_volume: return (1091ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.983s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301946072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffedde8-bdeb-4df3-8658-8bb16a94e3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7514534fc6ba4449af973212b8686e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:15:43Z,use_quota=True,user_id='976882eb11c149c89c7cb179c7c7b80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Creating volume 0ffedde8-bdeb-4df3-8658-8bb16a94e3e6 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:15:48 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:15:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:48 devstack quobyte-client[83210]: System call of process 101693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:48 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=158, name=volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7699d66-da85-4c38-a3c7-3ed2bce60ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb5514a-4ec5-4384-b096-252aa0650bcb', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61669af-0f42-42bd-aab6-f128a33a799c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-610e35db-2d49-4039-b403-b3c6b343369b-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:49 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume volume-7eb5514a-4ec5-4384-b096-252aa0650bcb (7eb5514a-4ec5-4384-b096-252aa0650bcb): created successfully Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61669af-0f42-42bd-aab6-f128a33a799c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (80988bd7-155f-4b28-bf88-5db3e4b11951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6 1073741824" returned: 0 in 0.930s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-610e35db-2d49-4039-b403-b3c6b343369b-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:49 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f1d9795f-ac4c-429c-bf5d-4d6cad2558e5 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created volume successfully. Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6" returned: 0 in 0.350s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] <== create_volume: return (1327ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:15:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2ef1df-dad9-477c-b12b-1567d1b9e6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5146273-7588-4caf-9b69-c3bc2fb728eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:50 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6 (0ffedde8-bdeb-4df3-8658-8bb16a94e3e6): created successfully Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5146273-7588-4caf-9b69-c3bc2fb728eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Flow 'volume_create_manager' (490f0f83-f196-4d47-b4e6-01c26d897db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:15:50 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-quobyte-610e35db-2d49-4039-b403-b3c6b343369b" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:50 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4e4863fd-1b26-467a-ab65-a2c5c4851037 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created volume successfully. Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.669s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-610e35db-2d49-4039-b403-b3c6b343369b" acquired by "delete_volume" :: waited 0.155s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:50 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Deleted volume successfully. Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc73f6ad-ac8c-4f05-8dc4-e94fb23e9f02]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-610e35db-2d49-4039-b403-b3c6b343369b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-7eb5514a-4ec5-4384-b096-252aa0650bcb-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4cad904c-2d0c-4374-b4e7-3cf95ec83d9d tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-df72e4e3-c90b-4b21-9ec2-c298be9aa7ea-delete_volume" released by "delete_volume" :: held 10.127s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-7eb5514a-4ec5-4384-b096-252aa0650bcb-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:51 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-quobyte-7eb5514a-4ec5-4384-b096-252aa0650bcb" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-7eb5514a-4ec5-4384-b096-252aa0650bcb" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-610e35db-2d49-4039-b403-b3c6b343369b" returned: 0 in 0.761s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-610e35db-2d49-4039-b403-b3c6b343369b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[827cffb2-d318-43c9-a67b-3e204aceea57]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7eb5514a-4ec5-4384-b096-252aa0650bcb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-610e35db-2d49-4039-b403-b3c6b343369b" returned: 0 in 0.314s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:52 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-610e35db-2d49-4039-b403-b3c6b343369b" released by "delete_volume" :: held 1.304s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:52 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Created reservations ['4cf5db50-65d2-4c0f-9d32-9b2137b2fa8e', '5e0f230f-6653-491f-a099-590c44392b3f', '0548f0a5-b01d-4be1-8ccb-dcbefc587ec8', 'c63764d5-256a-4585-a680-8ab57afa3d1f'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:15:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7eb5514a-4ec5-4384-b096-252aa0650bcb" returned: 0 in 0.887s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7eb5514a-4ec5-4384-b096-252aa0650bcb {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-7eb5514a-4ec5-4384-b096-252aa0650bcb" returned: 0 in 0.235s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-7eb5514a-4ec5-4384-b096-252aa0650bcb" released by "delete_volume" :: held 1.398s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.266s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:15:53 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Deleted volume successfully. Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created reservations ['da51ad80-506d-4ac5-aa06-b89db6900158', '06b25e15-ba5b-4a90-b74c-fa804528998b', 'ff8562f2-4636-4c16-8de5-b45f8d940034', '9682e51d-3943-4cd4-b353-4d36c1b7f1cf'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-36a90a26-5085-4882-a989-fb3ac5a5cccd tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-610e35db-2d49-4039-b403-b3c6b343369b-delete_volume" released by "delete_volume" :: held 4.204s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-b176bbce-f24b-4aff-be28-2a4230f6f58b-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-b176bbce-f24b-4aff-be28-2a4230f6f58b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.285s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:15:54 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Deleted volume successfully. Sep 18 12:15:54 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-quobyte-b176bbce-f24b-4aff-be28-2a4230f6f58b" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5e4389ad-54dd-4d57-97c3-b87682416fc2 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-7eb5514a-4ec5-4384-b096-252aa0650bcb-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-b176bbce-f24b-4aff-be28-2a4230f6f58b" acquired by "delete_volume" :: waited 0.055s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea016995-2b04-4609-a9cc-f605574b11ae]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b176bbce-f24b-4aff-be28-2a4230f6f58b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:54 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6-delete_volume" acquired by "delete_volume" :: waited 0.305s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:55 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:55 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-quobyte-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:55 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6" acquired by "delete_volume" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:55 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13d28cb-de58-4db4-922b-f00ef30b27e0]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:55 devstack quobyte-client[83210]: System call of process 101709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b176bbce-f24b-4aff-be28-2a4230f6f58b" returned: 0 in 0.915s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b176bbce-f24b-4aff-be28-2a4230f6f58b {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b176bbce-f24b-4aff-be28-2a4230f6f58b" returned: 0 in 0.178s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:55 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-b176bbce-f24b-4aff-be28-2a4230f6f58b" released by "delete_volume" :: held 1.417s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:56 devstack quobyte-client[83210]: System call of process 101710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6" returned: 0 in 0.783s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6" returned: 0 in 0.311s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6" released by "delete_volume" :: held 1.221s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Created reservations ['dc67cd2f-e170-4da1-b7f0-28aeb8b90234', 'c3dbcad2-2b20-4e7e-aca4-0a160e96dcc1', '599f48af-841d-48c9-8d70-5655295c86ce', '1f20217a-78d3-4a7d-be16-cd86f8daeb18'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:56 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created reservations ['3f7d7ac8-d774-4050-af03-45d75724be43', '575aff7a-4490-4caa-a23e-60a418632a06', 'ba629141-73e6-4ab1-97ed-2560c2f64f63', '331ec1d1-bf3e-43e0-8fd9-56028b214599'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.348s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:15:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Deleted volume successfully. Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-8595a0e3-8e7b-40c2-ad5d-e277254a1983-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-d1a4ce0c-01ca-45bc-8966-3750cfa9c918 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-b176bbce-f24b-4aff-be28-2a4230f6f58b-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.424s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:15:57 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Deleted volume successfully. Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-8595a0e3-8e7b-40c2-ad5d-e277254a1983-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-5023780d-b864-4390-aa94-04c695b3816a tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-0ffedde8-bdeb-4df3-8658-8bb16a94e3e6-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:58 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "cinder-quobyte-8595a0e3-8e7b-40c2-ad5d-e277254a1983" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-8595a0e3-8e7b-40c2-ad5d-e277254a1983" acquired by "delete_volume" :: waited 0.011s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9223b704-4361-445d-b176-f3dc365156ab]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-5399b09a-cac4-47d8-b80e-407d7948cfd7-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-5399b09a-cac4-47d8-b80e-407d7948cfd7-delete_volume" acquired by "delete_volume" :: waited 0.164s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:58 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-quobyte-5399b09a-cac4-47d8-b80e-407d7948cfd7" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983" returned: 0 in 0.801s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8595a0e3-8e7b-40c2-ad5d-e277254a1983" returned: 0 in 0.205s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:15:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-5399b09a-cac4-47d8-b80e-407d7948cfd7" acquired by "delete_volume" :: waited 0.260s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:15:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-quobyte-8595a0e3-8e7b-40c2-ad5d-e277254a1983" released by "delete_volume" :: held 1.129s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:15:59 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafea4ae-3fde-40ca-85c1-0f87594a27d4]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:15:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5399b09a-cac4-47d8-b80e-407d7948cfd7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:15:59 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Created reservations ['ac92e164-c78a-4fcc-a62b-2310252d798d', '179386bf-0e6f-4474-966a-649eacb431dd', 'f6e1428f-f114-49df-bb66-e532fdaed592', '45f032bd-f97a-464c-8c81-4871e7121503'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:00 devstack quobyte-client[83210]: System call of process 101723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5399b09a-cac4-47d8-b80e-407d7948cfd7" returned: 0 in 0.891s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5399b09a-cac4-47d8-b80e-407d7948cfd7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.231s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:00 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Deleted volume successfully. Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-5399b09a-cac4-47d8-b80e-407d7948cfd7" returned: 0 in 0.382s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-5399b09a-cac4-47d8-b80e-407d7948cfd7" released by "delete_volume" :: held 1.612s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-863f825f-af1b-4616-9ac3-352d5e1456c5 tempest-CreateVolumesFromImageTest-611791259 None] Lock "cinder-8595a0e3-8e7b-40c2-ad5d-e277254a1983-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created reservations ['721d5332-c1d0-4999-b9a6-2df853e89520', '2e0d140c-97d1-43f6-9657-1593d9bac963', 'f6c5f20c-5ab7-4b28-ae20-f390589992a2', '509e197d-7a69-4ac6-911d-1899430886e8'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.127s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:01 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:01 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Deleted volume successfully. Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-cea4a6ac-f9ab-478d-acce-2edea9fd6d26-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9c5fea6e-09e5-435f-8695-13bc3b73d898 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-5399b09a-cac4-47d8-b80e-407d7948cfd7-delete_volume" released by "delete_volume" :: held 4.199s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-cea4a6ac-f9ab-478d-acce-2edea9fd6d26-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:02 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Flow 'volume_create_manager' (9b55c3f3-a905-4dac-b797-36e521cd7046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec55816-52d1-4b6b-adaf-e117b772e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec55816-52d1-4b6b-adaf-e117b772e845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1653631141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8498d912-1b92-4f98-a657-dd55a0433545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e95d88699b490caf4650c51b5c486c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:02Z,use_quota=True,user_id='1ac64d8f31a847dfa383c8fd17b457fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d78ac3-b3fe-4783-8f3e-37ff371d3812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d78ac3-b3fe-4783-8f3e-37ff371d3812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ec780f-ebad-4f24-8dbd-bb136e093fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ec780f-ebad-4f24-8dbd-bb136e093fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8498d912-1b92-4f98-a657-dd55a0433545', 'volume_name': 'volume-8498d912-1b92-4f98-a657-dd55a0433545', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb5d501-8214-403e-867d-d2641d80d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb5d501-8214-403e-867d-d2641d80d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6513e20-792a-4cab-9759-ef018fbfd08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Volume 8498d912-1b92-4f98-a657-dd55a0433545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8498d912-1b92-4f98-a657-dd55a0433545', 'volume_size': 1} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1653631141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8498d912-1b92-4f98-a657-dd55a0433545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e95d88699b490caf4650c51b5c486c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:02Z,use_quota=True,user_id='1ac64d8f31a847dfa383c8fd17b457fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Creating volume 8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:02 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:16:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:03 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=159, name=volume-8498d912-1b92-4f98-a657-dd55a0433545, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:03 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-quobyte-cea4a6ac-f9ab-478d-acce-2edea9fd6d26" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-cea4a6ac-f9ab-478d-acce-2edea9fd6d26" acquired by "delete_volume" :: waited 0.094s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 1073741824" returned: 0 in 0.661s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9585addd-4525-4c5b-af47-3d2c8899d278]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545" returned: 0 in 0.228s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] <== create_volume: return (943ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:16:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6513e20-792a-4cab-9759-ef018fbfd08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8498d912-1b92-4f98-a657-dd55a0433545', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65af190f-583f-4ecb-9b71-fbc54480f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:04 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Volume volume-8498d912-1b92-4f98-a657-dd55a0433545 (8498d912-1b92-4f98-a657-dd55a0433545): created successfully Sep 18 12:16:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65af190f-583f-4ecb-9b71-fbc54480f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:04 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Flow 'volume_create_manager' (9b55c3f3-a905-4dac-b797-36e521cd7046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-986a9817-223e-497c-9bd8-3a5f58eef7df tempest-SnapshotDependencyTests-1835585236 None] Created volume successfully. Sep 18 12:16:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26" returned: 0 in 0.763s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-cea4a6ac-f9ab-478d-acce-2edea9fd6d26" returned: 0 in 0.104s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-cea4a6ac-f9ab-478d-acce-2edea9fd6d26" released by "delete_volume" :: held 1.168s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created reservations ['317295ec-dfe8-4950-b10a-885ee60d3f57', '4909176d-9b52-41db-a27a-bad5d93197c6', '5c64d7f7-e449-4eba-ab1d-5cb3c5af6e81', 'f924dde0-ea0f-4d76-b741-906feafa2e61'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.422s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:05 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Deleted volume successfully. Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8-delete_volume" acquired by "delete_volume" :: waited 0.249s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-60a3721a-857b-4904-960c-05ff3e4a9309 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-cea4a6ac-f9ab-478d-acce-2edea9fd6d26-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:05 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:05 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-quobyte-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8" acquired by "delete_volume" :: waited 0.017s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbc51f0-52e4-4ae6-82e1-938932c485be]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:06 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Creating offline snapshot 1484488f-96a5-4938-bbb1-a849a0f69453 of volume 8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808f5ec-9d74-4835-8a09-65bc054320ff]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8" returned: 0 in 0.800s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8" returned: 0 in 0.169s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:07 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8" released by "delete_volume" :: held 1.165s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545" returned: 0 in 0.715s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:07 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=160, name=volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 1G" returned: 0 in 0.398s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8498d912-1b92-4f98-a657-dd55a0433545 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] CMD "qemu-img rebase -u -b volume-8498d912-1b92-4f98-a657-dd55a0433545 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453" returned: 0 in 0.268s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created reservations ['1117703b-b7a2-43a4-a78a-5a8e815dae0f', '93b5ce5a-446e-476a-9a8c-cb0366f18f14', 'bba285c7-5809-41f6-9737-e81eb0b1c02a', '2511090d-447b-45e6-8e3a-31cf8f3a3406'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453" returned: 0 in 0.331s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453" returned: 0 in 0.279s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.info" returned: 0 in 0.294s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:09 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:16:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.info" returned: 0 in 0.327s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.962s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:10 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3ecaeec3-8b74-47b6-be79-e5be3cf04326 tempest-SnapshotDependencyTests-1835585236 None] Create snapshot completed successfully Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-3a122259-a308-48f6-bf42-bbd08945904e-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.435s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:10 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Deleted volume successfully. Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-3a122259-a308-48f6-bf42-bbd08945904e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.159s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:10 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-quobyte-b2f391d8-a242-4535-a9dd-2de7676fb623" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-b2f391d8-a242-4535-a9dd-2de7676fb623" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-quobyte-3a122259-a308-48f6-bf42-bbd08945904e" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-3a122259-a308-48f6-bf42-bbd08945904e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Deleting offline snapshot 3a122259-a308-48f6-bf42-bbd08945904e of volume b2f391d8-a242-4535-a9dd-2de7676fb623 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] snapshot_file for this snap is: volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[798f3fb7-a936-4fd4-83ab-35796807d85a]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:11 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-2f79d1b4-68f1-4244-b75b-d6b79720de58 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-4e0458f9-bcb6-4427-9fe6-4d1cbbe5ebf8-delete_volume" released by "delete_volume" :: held 5.234s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:11 devstack quobyte-client[83210]: System call of process 101798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e" returned: 0 in 0.562s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2f391d8-a242-4535-a9dd-2de7676fb623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:16:11 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ee59a5-5a10-40ab-bab9-d169e2f7845e]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623" returned: 0 in 0.628s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:12 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Flow 'volume_create_manager' (8b3da6a9-353a-4886-83c4-a98c5a15ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf716bd-807a-4644-9d33-8a481e836aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf716bd-807a-4644-9d33-8a481e836aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ebe7d7-90ef-4acb-a2d3-f72213e724e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c2922ee5a94b6986e8a79363a8f205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:11Z,use_quota=True,user_id='fd0b9a5bdb5f4e46b9f2543bdd414b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b06c0f-4cf1-48bd-bc50-43c6bc966a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b06c0f-4cf1-48bd-bc50-43c6bc966a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8482b059-cd0e-406a-8a92-2c85ae86cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG cinder.image.glance [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Creating Keystone auth plugin from conf {{(pid=83184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e" returned: 0 in 0.797s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:13 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623.3a122259-a308-48f6-bf42-bbd08945904e" returned: 0 in 0.380s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-3a122259-a308-48f6-bf42-bbd08945904e" released by "_delete_snapshot" :: held 2.563s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Flow 'volume_create_manager' (8a004f77-f18d-4bd4-a6d4-33dad821f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8fd796-202b-424a-8b11-872ac580908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-b2f391d8-a242-4535-a9dd-2de7676fb623" released by "delete_snapshot" :: held 2.854s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8fd796-202b-424a-8b11-872ac580908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33abc6b7-935a-498a-9950-1f1519c2f6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e95d88699b490caf4650c51b5c486c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1484488f-96a5-4938-bbb1-a849a0f69453,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:12Z,use_quota=True,user_id='1ac64d8f31a847dfa383c8fd17b457fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065f9b6b-13a2-484c-8cfd-29972ab79c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065f9b6b-13a2-484c-8cfd-29972ab79c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ca5d82-9574-4ca0-b1e2-f4d473f44f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ca5d82-9574-4ca0-b1e2-f4d473f44f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33abc6b7-935a-498a-9950-1f1519c2f6c4', 'volume_name': 'volume-33abc6b7-935a-498a-9950-1f1519c2f6c4', 'volume_size': 1, 'snapshot_id': '1484488f-96a5-4938-bbb1-a849a0f69453'}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fede3f-58b1-48b3-96a8-346a7a972caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fede3f-58b1-48b3-96a8-346a7a972caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95cad30-26b8-4ad8-ac0d-bee2117597d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:13 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Volume 33abc6b7-935a-498a-9950-1f1519c2f6c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33abc6b7-935a-498a-9950-1f1519c2f6c4', 'volume_size': 1, 'snapshot_id': '1484488f-96a5-4938-bbb1-a849a0f69453'} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-quobyte-1484488f-96a5-4938-bbb1-a849a0f69453-33abc6b7-935a-498a-9950-1f1519c2f6c4" by "_create_volume_from_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8482b059-cd0e-406a-8a92-2c85ae86cb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98ebe7d7-90ef-4acb-a2d3-f72213e724e7', 'volume_name': 'volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7', 'volume_size': 1, 'image_id': 'd6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4c61effea20e8ed394eb14bc9de2e6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9c2922ee5a94b6986e8a79363a8f205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a0407ad7d1d288e72d6f43912acaf0dd1577d81d7082ae5823ad170ff0614cb8391fe83c8875b389789f327480a333d8e90521daaf3e8d3db6faf076a13a821', 'id': 'd6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'created_at': datetime.datetime(2025, 9, 18, 10, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 16, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e/file', 'properties': {}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9dfff5-e13e-4892-b380-300b14fcde41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9dfff5-e13e-4892-b380-300b14fcde41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5accae31-dc2c-4ee3-b5e2-5e89621b5cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:13 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Volume 98ebe7d7-90ef-4acb-a2d3-f72213e724e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7', 'volume_size': 1, 'image_id': 'd6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4c61effea20e8ed394eb14bc9de2e6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9c2922ee5a94b6986e8a79363a8f205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a0407ad7d1d288e72d6f43912acaf0dd1577d81d7082ae5823ad170ff0614cb8391fe83c8875b389789f327480a333d8e90521daaf3e8d3db6faf076a13a821', 'id': 'd6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'created_at': datetime.datetime(2025, 9, 18, 10, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 16, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e/file', 'properties': {}}, 'image_service': } Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Cloning 98ebe7d7-90ef-4acb-a2d3-f72213e724e7 from image d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'metadata': {}}]). {{(pid=83184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-1484488f-96a5-4938-bbb1-a849a0f69453-33abc6b7-935a-498a-9950-1f1519c2f6c4" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Creating volume 33abc6b7-935a-498a-9950-1f1519c2f6c4 from snapshot 1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-quobyte-33abc6b7-935a-498a-9950-1f1519c2f6c4" by "_copy_volume_from_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-33abc6b7-935a-498a-9950-1f1519c2f6c4" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] snapshot: 1484488f-96a5-4938-bbb1-a849a0f69453, volume: 33abc6b7-935a-498a-9950-1f1519c2f6c4, {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[75673ca8-b750-4a20-8020-ff5d3d2863e2]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created reservations ['4960f511-0053-4a80-890f-28b56d364a3b', 'd6d4dfc9-8bfb-46d8-933c-a2069fe81b29', '8691d16d-e34c-410f-98e7-7547ce2307dc', '4b58f859-df73-4227-be39-7edd3b9991b1'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 18 12:16:14 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Image download 0.00 MB at 0.00 MB/s Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[265dd213-4e6c-4432-b5af-72ac3c56b58d]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:14 devstack quobyte-client[83210]: System call of process 101808 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453" returned: 0 in 0.953s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8498d912-1b92-4f98-a657-dd55a0433545(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Creating direct copy from snapshot {{(pid=83184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b00c1d-5f86-4786-b548-f94c9f2e3874]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:15 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD Sep 18 12:16:15 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:16:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Delete snapshot completed successfully. Sep 18 12:16:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-4e29a34d-a957-4423-a795-19e4b4caf275 tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-3a122259-a308-48f6-bf42-bbd08945904e-delete_snapshot" released by "delete_snapshot" :: held 4.909s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:15 devstack quobyte-client[83210]: System call of process 101812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545" returned: 0 in 0.827s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:15 devstack cinder-volume[83184]: DEBUG cinder.utils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4 not found in is_blk_device check {{(pid=83184) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 18 12:16:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:16 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=162, name=volume-33abc6b7-935a-498a-9950-1f1519c2f6c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-b2f391d8-a242-4535-a9dd-2de7676fb623-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-b2f391d8-a242-4535-a9dd-2de7676fb623-delete_volume" acquired by "delete_volume" :: waited 0.173s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:17 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "cinder-quobyte-b2f391d8-a242-4535-a9dd-2de7676fb623" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-b2f391d8-a242-4535-a9dd-2de7676fb623" acquired by "delete_volume" :: waited 0.075s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:17 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[defb67d9-a3f9-4ed0-b68c-20d40559268d]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623" returned: 0 in 2.622s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:20 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:21 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-b2f391d8-a242-4535-a9dd-2de7676fb623" returned: 0 in 0.402s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:21 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-quobyte-b2f391d8-a242-4535-a9dd-2de7676fb623" released by "delete_volume" :: held 4.242s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:21 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 18 12:16:22 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=74,cinder:UPDATE=115,cinder:DELETE=11,cinder:INSERT=29 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:16:22 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=112,cinder:SELECT=76,cinder:DELETE=13,cinder:INSERT=15 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:16:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD" returned: 0 in 8.024s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:22 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4" returned: 0 in 7.896s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:23 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b325a70-5c8f-4037-bd2b-b13115b84fc9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:23 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:23 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD Sep 18 12:16:23 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Created reservations ['b853fb7b-015e-4b34-8d92-d55eb3dbfabf', '79837270-9d69-48f5-832a-22b610d6a501', '0c41a058-1b25-433c-b43e-3048d182d666', '9d26fe0e-c61f-479d-b255-6caa35473523'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545" returned: 0 in 0.852s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Image conversion details: src /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4 {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 12:16:24 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Converted 1024.00 MB image at 129.33 MB/s Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4 is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.040s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:24 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4" returned: 0 in 0.354s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.234s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-33abc6b7-935a-498a-9950-1f1519c2f6c4" released by "_copy_volume_from_snapshot" :: held 11.426s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:25 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Deleted volume successfully. Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-1484488f-96a5-4938-bbb1-a849a0f69453-33abc6b7-935a-498a-9950-1f1519c2f6c4" released by "_create_volume_from_snapshot" :: held 11.594s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.669s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-3fc834a8-6686-4778-9a29-1f1f21a4610c tempest-CreateVolumesFromSnapshotTest-1590813766 None] Lock "cinder-b2f391d8-a242-4535-a9dd-2de7676fb623-delete_volume" released by "delete_volume" :: held 9.296s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95cad30-26b8-4ad8-ac0d-bee2117597d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33abc6b7-935a-498a-9950-1f1519c2f6c4', 'volume_size': 1, 'snapshot_id': '1484488f-96a5-4938-bbb1-a849a0f69453'}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:25 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de851c5b-dfcb-4d0b-ab45-fa70e22ad134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:26 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Volume volume-33abc6b7-935a-498a-9950-1f1519c2f6c4 (33abc6b7-935a-498a-9950-1f1519c2f6c4): created successfully Sep 18 12:16:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de851c5b-dfcb-4d0b-ab45-fa70e22ad134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:26 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Flow 'volume_create_manager' (8a004f77-f18d-4bd4-a6d4-33dad821f42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:26 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-ffed4847-a4c5-4673-83de-e6b61db3617a tempest-SnapshotDependencyTests-1835585236 None] Created volume successfully. Sep 18 12:16:26 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 18 12:16:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD" returned: 1 in 3.992s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:26 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:16:26 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Temporary image d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e is fetched for user fd0b9a5bdb5f4e46b9f2543bdd414b77. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e0a43d-1ed5-4aa5-9418-5e49e364d8da]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:27 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD Sep 18 12:16:27 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-1484488f-96a5-4938-bbb1-a849a0f69453-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-1484488f-96a5-4938-bbb1-a849a0f69453-delete_snapshot" acquired by "delete_snapshot" :: waited 0.110s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:27 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-quobyte-8498d912-1b92-4f98-a657-dd55a0433545" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-8498d912-1b92-4f98-a657-dd55a0433545" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-quobyte-1484488f-96a5-4938-bbb1-a849a0f69453" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-1484488f-96a5-4938-bbb1-a849a0f69453" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Deleting offline snapshot 1484488f-96a5-4938-bbb1-a849a0f69453 of volume 8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] snapshot_file for this snap is: volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8afbae7-2a13-466b-80fa-95c5e8b60ab9]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:27 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453" returned: 0 in 0.655s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:28 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8498d912-1b92-4f98-a657-dd55a0433545(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:16:28 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4ca641-888a-4440-bd8b-2730175f40e3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:28 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545" returned: 0 in 0.623s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:29 devstack quobyte-client[83210]: System call of process 101854 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453" returned: 0 in 0.313s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:29 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 18 12:16:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD" returned: 0 in 2.725s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:29 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545.1484488f-96a5-4938-bbb1-a849a0f69453" returned: 0 in 0.190s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-1484488f-96a5-4938-bbb1-a849a0f69453" released by "_delete_snapshot" :: held 2.187s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:30 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-8498d912-1b92-4f98-a657-dd55a0433545" released by "delete_snapshot" :: held 2.251s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:30 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD Sep 18 12:16:30 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 12:16:30 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Created reservations ['adc06265-331d-4613-b463-977825f64179', '48ec080c-f14f-4f88-8258-9685e731a65f', '4d60f3d3-9857-4b02-bfac-7a4135ad2685', 'b01a12d0-4f16-4f3c-a8b6-4138444c0b27'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:31 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Delete snapshot completed successfully. Sep 18 12:16:31 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1a84ebc2-7457-46dd-bdaa-5b24357afa51 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-1484488f-96a5-4938-bbb1-a849a0f69453-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-8498d912-1b92-4f98-a657-dd55a0433545-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-8498d912-1b92-4f98-a657-dd55a0433545-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:32 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 18 12:16:32 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-quobyte-8498d912-1b92-4f98-a657-dd55a0433545" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD" returned: 1 in 2.378s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ebe7d7-90ef-4acb-a2d3-f72213e724e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c2922ee5a94b6986e8a79363a8f205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:11Z,use_quota=True,user_id='fd0b9a5bdb5f4e46b9f2543bdd414b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Creating volume 98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:32 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:32 devstack quobyte-client[83210]: System call of process 101866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:32 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=163, name=volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-8498d912-1b92-4f98-a657-dd55a0433545" acquired by "delete_volume" :: waited 0.250s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea4990b-faa2-4ee0-b7ee-64004e14cfc2]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 1073741824" returned: 0 in 0.422s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" returned: 0 in 0.123s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] <== create_volume: return (671ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:16:32 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545" returned: 0 in 0.582s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8498d912-1b92-4f98-a657-dd55a0433545" returned: 0 in 0.131s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:33 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-8498d912-1b92-4f98-a657-dd55a0433545" released by "delete_volume" :: held 0.987s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:33 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Attempting download of d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e ((None, [{'url': 'file:///opt/stack/data/glance/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'metadata': {}}])) to volume 98ebe7d7-90ef-4acb-a2d3-f72213e724e7. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 18 12:16:33 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7c4faa-21c8-46ff-bd02-cac19657ba08]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:33 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_tilc0e0i {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:33 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Created reservations ['20fc149a-8fcb-4e6e-92ab-46c7fbf195e5', '8ca4bae1-b4d9-446a-8450-ce98b27f2435', '88534302-9cb7-4500-9f98-14a40bf823e5', '47b19c03-6944-49f5-9837-dee86c046687'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_tilc0e0i" returned: 0 in 0.547s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_tilc0e0i {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_tilc0e0i" returned: 1 in 0.569s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_tilc0e0i' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:16:34 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0e60ab-f370-47a6-b105-237cee459aa1]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:34 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.039s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-33abc6b7-935a-498a-9950-1f1519c2f6c4-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.381s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:35 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-33abc6b7-935a-498a-9950-1f1519c2f6c4-delete_volume" acquired by "delete_volume" :: waited 0.184s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:36 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Deleted volume successfully. Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD" returned: 1 in 0.790s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e was raw, converting to raw {{(pid=83184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:36 devstack quobyte-client[83210]: System call of process 101884 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:36 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=163, name=volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" returned: 0 in 0.181s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e_9kf7868tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 18 12:16:36 devstack cinder-volume[83184]: INFO cinder.image.image_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:36 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "cinder-quobyte-33abc6b7-935a-498a-9950-1f1519c2f6c4" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-f4fefb0f-a63e-4d8a-8114-a68c3e839c77 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-8498d912-1b92-4f98-a657-dd55a0433545-delete_volume" released by "delete_volume" :: held 4.763s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 1G" returned: 0 in 0.438s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-33abc6b7-935a-498a-9950-1f1519c2f6c4" acquired by "delete_volume" :: waited 0.062s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13320398-3acc-40b0-a574-950d7d981111]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:36 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb58ea7-71ab-4126-9dc6-813c69116a38]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4" returned: 0 in 0.497s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-33abc6b7-935a-498a-9950-1f1519c2f6c4" returned: 0 in 0.109s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:37 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-quobyte-33abc6b7-935a-498a-9950-1f1519c2f6c4" released by "delete_volume" :: held 0.983s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" returned: 0 in 0.879s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:37 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" returned: 1 in 0.519s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:38 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:16:38 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Downloaded image d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e ((None, [{'url': 'file:///opt/stack/data/glance/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'metadata': {}}])) to volume 98ebe7d7-90ef-4acb-a2d3-f72213e724e7 successfully. {{(pid=83184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 18 12:16:38 devstack cinder-volume[83184]: DEBUG cinder.image.image_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Temporary image d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e for user fd0b9a5bdb5f4e46b9f2543bdd414b77 is deleted. {{(pid=83184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 18 12:16:38 devstack cinder-volume[83184]: DEBUG cinder.volume.volume_utils [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Marking volume 98ebe7d7-90ef-4acb-a2d3-f72213e724e7 as bootable. {{(pid=83184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 18 12:16:38 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:38 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (c4f0eba1-606f-47f2-92f3-8217a1089320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:38 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f365817-ee07-4021-a4f7-671789d39993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f365817-ee07-4021-a4f7-671789d39993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1658834879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8810b804-b7e9-4f43-a326-f4fa94d4edcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:37Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4db54a5-1c71-4f29-bbdb-31351a30be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4db54a5-1c71-4f29-bbdb-31351a30be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ae9ed3-aa39-4136-9ef2-1592269f95cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ae9ed3-aa39-4136-9ef2-1592269f95cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8810b804-b7e9-4f43-a326-f4fa94d4edcd', 'volume_name': 'volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255c817a-1221-404f-8841-a61eb3351ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255c817a-1221-404f-8841-a61eb3351ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd8c656-5f6f-44a5-afa3-c0f3a2a3f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:39 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume 8810b804-b7e9-4f43-a326-f4fa94d4edcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd', 'volume_size': 1} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1658834879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8810b804-b7e9-4f43-a326-f4fa94d4edcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:37Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Creating volume 8810b804-b7e9-4f43-a326-f4fa94d4edcd {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:39 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:39 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=164, name=volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd 1073741824" returned: 0 in 0.425s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Copying metadata from image d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e to 98ebe7d7-90ef-4acb-a2d3-f72213e724e7. {{(pid=83184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Creating volume glance metadata for volume 98ebe7d7-90ef-4acb-a2d3-f72213e724e7 backed by image d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e with: {'image_id': 'd6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a4c61effea20e8ed394eb14bc9de2e6d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd" returned: 0 in 0.240s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] <== create_volume: return (702ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:16:39 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd8c656-5f6f-44a5-afa3-c0f3a2a3f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:40 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2b6565-c742-44ff-a5f4-7437e2d04782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:41 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Created reservations ['ec198abd-ec3f-48f5-bc6a-62ffa1f0edbb', '62701094-b354-4175-9ea8-20dc7401ec6c', '7000aa8b-193c-4023-9730-c81ac35585e4', '16f465b7-d34a-4128-bbdf-0625debbe8ec'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:41 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd (8810b804-b7e9-4f43-a326-f4fa94d4edcd): created successfully Sep 18 12:16:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2b6565-c742-44ff-a5f4-7437e2d04782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (c4f0eba1-606f-47f2-92f3-8217a1089320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5accae31-dc2c-4ee3-b5e2-5e89621b5cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7', 'volume_size': 1, 'image_id': 'd6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4c61effea20e8ed394eb14bc9de2e6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9c2922ee5a94b6986e8a79363a8f205', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a0407ad7d1d288e72d6f43912acaf0dd1577d81d7082ae5823ad170ff0614cb8391fe83c8875b389789f327480a333d8e90521daaf3e8d3db6faf076a13a821', 'id': 'd6adc6a3-ce5e-4b82-ad85-39c8a67bf24e', 'created_at': datetime.datetime(2025, 9, 18, 10, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 10, 16, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6adc6a3-ce5e-4b82-ad85-39c8a67bf24e/file', 'properties': {}}, 'image_service': }' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:41 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a7cd8c-9927-41bb-97dd-3f5813890a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:41 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-5ba9d09b-ebf8-42a3-a1b7-613b459ae9be tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created volume successfully. Sep 18 12:16:42 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Volume volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 (98ebe7d7-90ef-4acb-a2d3-f72213e724e7): created successfully Sep 18 12:16:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a7cd8c-9927-41bb-97dd-3f5813890a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:42 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Flow 'volume_create_manager' (8b3da6a9-353a-4886-83c4-a98c5a15ece5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:42 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-960739af-9b80-44bc-9fae-d50f7beef6ab tempest-VolumeImageDependencyTests-1437254379 None] Created volume successfully. Sep 18 12:16:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:42 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:42 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:43 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.122s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:43 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:43 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Deleted volume successfully. Sep 18 12:16:44 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-049c2339-f20a-4e43-aa37-052ee679cfe1 tempest-SnapshotDependencyTests-1835585236 None] Lock "cinder-33abc6b7-935a-498a-9950-1f1519c2f6c4-delete_volume" released by "delete_volume" :: held 8.104s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.088s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Acquiring lock "cinder-98ebe7d7-90ef-4acb-a2d3-f72213e724e7-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Lock "cinder-98ebe7d7-90ef-4acb-a2d3-f72213e724e7-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:45 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Acquiring lock "cinder-quobyte-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Lock "cinder-quobyte-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" acquired by "delete_volume" :: waited 0.013s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:45 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a044e1-c7a5-495b-a9c2-4adde71630f6]: (4, 'raw') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:46 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:46 devstack quobyte-client[83210]: System call of process 101906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" returned: 0 in 0.988s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:47 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:47 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:47 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:47 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (7be9292a-520b-4577-8701-16d746162768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a7e2a7-eeaa-46f6-9afd-6d499daaaf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:48 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (8bc1ebf9-65ed-4149-8651-2c88c09c2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ad426b-cda1-49f8-9bee-6bf7a43d3698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a7e2a7-eeaa-46f6-9afd-6d499daaaf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1648567769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed7485c-b54a-4459-a260-c2bbdca96141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:46Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf73937c-bc63-45f9-8eb5-4b2216e75e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf73937c-bc63-45f9-8eb5-4b2216e75e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a462e7b-667b-4396-8ac7-e351c15d2ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a462e7b-667b-4396-8ac7-e351c15d2ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed7485c-b54a-4459-a260-c2bbdca96141', 'volume_name': 'volume-bed7485c-b54a-4459-a260-c2bbdca96141', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f64d07-a583-4705-b47e-55762c6e1e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f64d07-a583-4705-b47e-55762c6e1e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8442801b-1a8f-4559-9606-404d69d956ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:48 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume bed7485c-b54a-4459-a260-c2bbdca96141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed7485c-b54a-4459-a260-c2bbdca96141', 'volume_size': 1} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1648567769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed7485c-b54a-4459-a260-c2bbdca96141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:46Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Creating volume bed7485c-b54a-4459-a260-c2bbdca96141 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:48 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:16:48 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-bed7485c-b54a-4459-a260-c2bbdca96141 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:48 devstack quobyte-client[83210]: System call of process 101911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:48 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=165, name=volume-bed7485c-b54a-4459-a260-c2bbdca96141, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" returned: 1 in 2.230s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7' failed. Not Retrying. {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:49 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (2a585e37-8200-40c3-8be5-9c3746b50f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e8aa0a-b27d-4d15-a323-9f3e07a17859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:49 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (cc68b05e-41c4-4be3-b19e-63f7ac262549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e694503-3596-42a7-ad96-2f132c30911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ad426b-cda1-49f8-9bee-6bf7a43d3698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875270524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa19cc4-aae4-4df4-b963-9227c2b0a7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:47Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2243249f-3e99-4639-80ab-c5a2af9459fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2243249f-3e99-4639-80ab-c5a2af9459fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9562424f-8f4e-4f60-b711-283cb48e791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9562424f-8f4e-4f60-b711-283cb48e791f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa19cc4-aae4-4df4-b963-9227c2b0a7f0', 'volume_name': 'volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa5320d-130d-456f-bf93-795a9f4eba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa5320d-130d-456f-bf93-795a9f4eba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8355bae4-5e82-4bc4-a57c-42147a6e689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:49 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume 8aa19cc4-aae4-4df4-b963-9227c2b0a7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0', 'volume_size': 1} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:49 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (ad3156a7-967a-4cf0-a807-b139bbb920c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:49 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce47c0cd-08f7-4d45-a7e9-5e9048313a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-bed7485c-b54a-4459-a260-c2bbdca96141 1073741824" returned: 0 in 1.303s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" returned: 0 in 0.696s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-bed7485c-b54a-4459-a260-c2bbdca96141 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e694503-3596-42a7-ad96-2f132c30911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570791409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48be50cb-d159-460f-b0f6-8f0e0a1a3d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:49Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67790db7-73e0-4583-9709-06de6f4d4ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67790db7-73e0-4583-9709-06de6f4d4ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f26504b-9e4b-43bc-af44-05720257a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f26504b-9e4b-43bc-af44-05720257a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48be50cb-d159-460f-b0f6-8f0e0a1a3d99', 'volume_name': 'volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3448628e-0289-4e31-8a80-fea2c30782a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3448628e-0289-4e31-8a80-fea2c30782a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f918847-bc64-4e76-aa28-c4601de4ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume 48be50cb-d159-460f-b0f6-8f0e0a1a3d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99', 'volume_size': 1} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e8aa0a-b27d-4d15-a323-9f3e07a17859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-5449157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c32376d-652b-4c47-9979-07e21cb0da1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:48Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abcf4cd-7043-4c08-a087-3945ca522a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abcf4cd-7043-4c08-a087-3945ca522a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a8ea09b-b0bd-46bd-9df0-04aa3cafa021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a8ea09b-b0bd-46bd-9df0-04aa3cafa021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c32376d-652b-4c47-9979-07e21cb0da1f', 'volume_name': 'volume-2c32376d-652b-4c47-9979-07e21cb0da1f', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f26dff-bfdc-4be5-9071-461546c42c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f26dff-bfdc-4be5-9071-461546c42c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66cf986-a0de-480d-9442-724fbbeb3b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume 2c32376d-652b-4c47-9979-07e21cb0da1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c32376d-652b-4c47-9979-07e21cb0da1f', 'volume_size': 1} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce47c0cd-08f7-4d45-a7e9-5e9048313a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458025821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f411dd-f69f-4086-ba8b-fa5f97b05608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:47Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727d23b9-4638-4989-a0e5-94763b32b903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727d23b9-4638-4989-a0e5-94763b32b903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db09533-dc1e-4f3b-8486-912eec980371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db09533-dc1e-4f3b-8486-912eec980371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f411dd-f69f-4086-ba8b-fa5f97b05608', 'volume_name': 'volume-34f411dd-f69f-4086-ba8b-fa5f97b05608', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a892fa-c0b2-4f2c-a482-2588243f1e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a892fa-c0b2-4f2c-a482-2588243f1e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a99a1a-45c4-43a5-83d2-3acf4076fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:50 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume 34f411dd-f69f-4086-ba8b-fa5f97b05608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f411dd-f69f-4086-ba8b-fa5f97b05608', 'volume_size': 1} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Lock "cinder-quobyte-98ebe7d7-90ef-4acb-a2d3-f72213e724e7" released by "delete_volume" :: held 4.715s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-bed7485c-b54a-4459-a260-c2bbdca96141" returned: 0 in 0.682s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] <== create_volume: return (2034ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.832s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875270524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa19cc4-aae4-4df4-b963-9227c2b0a7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:47Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Creating volume 8aa19cc4-aae4-4df4-b963-9227c2b0a7f0 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:50 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:16:50 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:50 devstack quobyte-client[83210]: System call of process 101918 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:51 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=166, name=volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8442801b-1a8f-4559-9606-404d69d956ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed7485c-b54a-4459-a260-c2bbdca96141', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b830ab-7c2e-4a59-bf9e-a3d5b281da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0 1073741824" returned: 0 in 0.847s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:51 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:51 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume volume-bed7485c-b54a-4459-a260-c2bbdca96141 (bed7485c-b54a-4459-a260-c2bbdca96141): created successfully Sep 18 12:16:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b830ab-7c2e-4a59-bf9e-a3d5b281da56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:51 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (7be9292a-520b-4577-8701-16d746162768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:52 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-f8efdeb4-01a7-410d-809d-bbf16693cb32 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created volume successfully. Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0" returned: 0 in 0.575s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] <== create_volume: return (1448ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.743s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570791409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48be50cb-d159-460f-b0f6-8f0e0a1a3d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:49Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Creating volume 48be50cb-d159-460f-b0f6-8f0e0a1a3d99 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:52 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:52 devstack quobyte-client[83210]: System call of process 101922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:52 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=167, name=volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8355bae4-5e82-4bc4-a57c-42147a6e689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a56c251-13de-4399-a0f5-546d592b1c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99 1073741824" returned: 0 in 0.571s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:52 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:53 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0 (8aa19cc4-aae4-4df4-b963-9227c2b0a7f0): created successfully Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a56c251-13de-4399-a0f5-546d592b1c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (8bc1ebf9-65ed-4149-8651-2c88c09c2a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Created reservations ['237be961-064d-431b-9fe4-e477ee79b84e', '07d58fe2-a2df-4482-b1b9-4fecda6720b5', '7cef5850-1506-48f2-bdd3-5b4cce4e5519', 'f9ac98bd-d98d-4b7e-b03e-2d40d8662e16'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:53 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-03aff993-b0dc-4d1f-94dd-83d3a1f15cbe tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created volume successfully. Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99" returned: 0 in 0.432s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] <== create_volume: return (1037ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.760s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-5449157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c32376d-652b-4c47-9979-07e21cb0da1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:48Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Creating volume 2c32376d-652b-4c47-9979-07e21cb0da1f {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:53 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2c32376d-652b-4c47-9979-07e21cb0da1f 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:53 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=168, name=volume-2c32376d-652b-4c47-9979-07e21cb0da1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f918847-bc64-4e76-aa28-c4601de4ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0671c6-b0f9-48bb-80f6-01a4f0b3e716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2c32376d-652b-4c47-9979-07e21cb0da1f 1073741824" returned: 0 in 0.530s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:53 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2c32376d-652b-4c47-9979-07e21cb0da1f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2c32376d-652b-4c47-9979-07e21cb0da1f" returned: 0 in 0.176s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] <== create_volume: return (768ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.581s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458025821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f411dd-f69f-4086-ba8b-fa5f97b05608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ab99303bf4dd9884d77c2c46b0311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:16:47Z,use_quota=True,user_id='e2f1ef856e8c46339faab16dfc435a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Creating volume 34f411dd-f69f-4086-ba8b-fa5f97b05608 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:16:54 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-34f411dd-f69f-4086-ba8b-fa5f97b05608 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:54 devstack quobyte-client[83210]: System call of process 101930 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:16:54 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=169, name=volume-34f411dd-f69f-4086-ba8b-fa5f97b05608, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:16:54 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99 (48be50cb-d159-460f-b0f6-8f0e0a1a3d99): created successfully Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0671c6-b0f9-48bb-80f6-01a4f0b3e716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:54 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (cc68b05e-41c4-4be3-b19e-63f7ac262549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:55 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-e0c38010-6643-4f82-835c-9b9ce16c5d16 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created volume successfully. Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66cf986-a0de-480d-9442-724fbbeb3b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c32376d-652b-4c47-9979-07e21cb0da1f', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec27e55-5a27-49e8-ae8a-d8e412d34c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:55 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume volume-2c32376d-652b-4c47-9979-07e21cb0da1f (2c32376d-652b-4c47-9979-07e21cb0da1f): created successfully Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec27e55-5a27-49e8-ae8a-d8e412d34c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (2a585e37-8200-40c3-8be5-9c3746b50f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-34f411dd-f69f-4086-ba8b-fa5f97b05608 1073741824" returned: 0 in 1.599s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-34f411dd-f69f-4086-ba8b-fa5f97b05608 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:55 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.851s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Deleted volume successfully. Sep 18 12:16:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a72a59c9-fc61-48ef-9249-3b383fc88acc tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created volume successfully. Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-34f411dd-f69f-4086-ba8b-fa5f97b05608" returned: 0 in 0.491s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] <== create_volume: return (2124ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a99a1a-45c4-43a5-83d2-3acf4076fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f411dd-f69f-4086-ba8b-fa5f97b05608', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe1f536-ed39-4013-a6ac-b856a7b19b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-84de947a-272e-49c0-bc86-0c0ac9249a0a tempest-VolumeImageDependencyTests-1437254379 None] Lock "cinder-98ebe7d7-90ef-4acb-a2d3-f72213e724e7-delete_volume" released by "delete_volume" :: held 10.940s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:56 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume volume-34f411dd-f69f-4086-ba8b-fa5f97b05608 (34f411dd-f69f-4086-ba8b-fa5f97b05608): created successfully Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe1f536-ed39-4013-a6ac-b856a7b19b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:16:56 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Flow 'volume_create_manager' (ad3156a7-967a-4cf0-a807-b139bbb920c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:16:56 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-11ec7ae7-39e0-4a08-beb0-750620c4d10e tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created volume successfully. Sep 18 12:16:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-48be50cb-d159-460f-b0f6-8f0e0a1a3d99-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-48be50cb-d159-460f-b0f6-8f0e0a1a3d99-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:57 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:16:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-quobyte-48be50cb-d159-460f-b0f6-8f0e0a1a3d99" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:57 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-48be50cb-d159-460f-b0f6-8f0e0a1a3d99" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:16:57 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13022102-eebc-42d7-857c-59256857d8f3]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:16:57 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99" returned: 0 in 0.590s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:58 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-48be50cb-d159-460f-b0f6-8f0e0a1a3d99" returned: 0 in 0.161s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:58 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-48be50cb-d159-460f-b0f6-8f0e0a1a3d99" released by "delete_volume" :: held 1.035s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:58 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created reservations ['ce490a8c-a546-49d1-891d-44c5e62c9cf2', '403518bd-2a47-46c8-a3f1-0fe29e945f28', '71866b28-03c7-4a45-a4b0-b4b5151c883f', '184e5090-0816-42c9-a1fb-4f44e553cae3'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.129s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:16:59 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Deleted volume successfully. Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-2c32376d-652b-4c47-9979-07e21cb0da1f-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-fdf2f1b4-3d16-46d2-8bbc-fdd666bef1e1 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-48be50cb-d159-460f-b0f6-8f0e0a1a3d99-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:16:59 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-2c32376d-652b-4c47-9979-07e21cb0da1f-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:00 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-quobyte-2c32376d-652b-4c47-9979-07e21cb0da1f" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:00 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-2c32376d-652b-4c47-9979-07e21cb0da1f" acquired by "delete_volume" :: waited 0.016s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:00 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec064fe5-309e-43f3-8656-b21a1fc4bdc1]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2c32376d-652b-4c47-9979-07e21cb0da1f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:00 devstack quobyte-client[83210]: System call of process 101942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:17:00 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2c32376d-652b-4c47-9979-07e21cb0da1f" returned: 0 in 0.770s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2c32376d-652b-4c47-9979-07e21cb0da1f {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:01 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-2c32376d-652b-4c47-9979-07e21cb0da1f" returned: 0 in 0.321s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:01 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-2c32376d-652b-4c47-9979-07e21cb0da1f" released by "delete_volume" :: held 1.455s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:02 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Flow 'volume_create_manager' (039c4acd-242b-44fa-849b-d06e1a0e5aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf5981f-79f5-4968-8915-549411c6aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf5981f-79f5-4968-8915-549411c6aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e465c1-d68a-4c16-8f54-3e7b47035131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff50fe3f307b45339f84202dc8f9824f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:17:01Z,use_quota=True,user_id='d506db2ed1694d87a4dca003b82e162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756a13eb-ed78-44c8-b472-5136bc8c09be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756a13eb-ed78-44c8-b472-5136bc8c09be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35de4fda-4263-41eb-9d23-66c33357eb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35de4fda-4263-41eb-9d23-66c33357eb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e465c1-d68a-4c16-8f54-3e7b47035131', 'volume_name': 'volume-a1e465c1-d68a-4c16-8f54-3e7b47035131', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a395682-47af-4497-8c86-b40b2cb7a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a395682-47af-4497-8c86-b40b2cb7a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed156254-b780-4220-94cf-0b789004f2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:02 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Volume a1e465c1-d68a-4c16-8f54-3e7b47035131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e465c1-d68a-4c16-8f54-3e7b47035131', 'volume_size': 1} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e465c1-d68a-4c16-8f54-3e7b47035131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff50fe3f307b45339f84202dc8f9824f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:17:01Z,use_quota=True,user_id='d506db2ed1694d87a4dca003b82e162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Creating volume a1e465c1-d68a-4c16-8f54-3e7b47035131 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:17:02 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a1e465c1-d68a-4c16-8f54-3e7b47035131 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:02 devstack quobyte-client[83210]: System call of process 101952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:17:02 devstack quobyte-client[83210]: System call of process 101952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:17:02 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=170, name=volume-a1e465c1-d68a-4c16-8f54-3e7b47035131, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created reservations ['fc77d9a4-b4ad-445d-bb81-b21e6eadbf7f', '2b9d112f-3218-4b04-8e72-a3b53447d072', 'fb73edff-e543-4554-bf2c-f2b4774d5b21', 'd3b914a3-2e26-46d4-a2c9-5fb2a115adf7'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a1e465c1-d68a-4c16-8f54-3e7b47035131 1073741824" returned: 0 in 0.550s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:02 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a1e465c1-d68a-4c16-8f54-3e7b47035131 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a1e465c1-d68a-4c16-8f54-3e7b47035131" returned: 0 in 0.440s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] <== create_volume: return (1044ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed156254-b780-4220-94cf-0b789004f2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e465c1-d68a-4c16-8f54-3e7b47035131', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e92e60b-ba5f-4410-bb80-ad143ae8d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:03 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Volume volume-a1e465c1-d68a-4c16-8f54-3e7b47035131 (a1e465c1-d68a-4c16-8f54-3e7b47035131): created successfully Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e92e60b-ba5f-4410-bb80-ad143ae8d286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Flow 'volume_create_manager' (039c4acd-242b-44fa-849b-d06e1a0e5aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:17:03 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-42117c07-3d62-442d-9dfe-d439daa7e318 tempest-CinderUnicodeTest-1272775023 None] Created volume successfully. Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:03 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:04 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.343s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:04 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:17:04 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Deleted volume successfully. Sep 18 12:17:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-34f411dd-f69f-4086-ba8b-fa5f97b05608-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-34f411dd-f69f-4086-ba8b-fa5f97b05608-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-395eef02-dd93-4725-b96f-f6292ddd8135 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-2c32376d-652b-4c47-9979-07e21cb0da1f-delete_volume" released by "delete_volume" :: held 4.799s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:04 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-quobyte-34f411dd-f69f-4086-ba8b-fa5f97b05608" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:04 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-34f411dd-f69f-4086-ba8b-fa5f97b05608" acquired by "delete_volume" :: waited 0.028s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:04 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a49eca9-c9d0-4cb4-9996-9d142a89f92f]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-34f411dd-f69f-4086-ba8b-fa5f97b05608 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:05 devstack quobyte-client[83210]: System call of process 101995 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 18 12:17:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-34f411dd-f69f-4086-ba8b-fa5f97b05608" returned: 0 in 0.748s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:05 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-34f411dd-f69f-4086-ba8b-fa5f97b05608 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-34f411dd-f69f-4086-ba8b-fa5f97b05608" returned: 0 in 0.405s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:06 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Flow 'volume_create_manager' (238d186f-1c07-4073-be23-081cb4d7457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e372b62-5781-450c-b295-042e95a59895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-34f411dd-f69f-4086-ba8b-fa5f97b05608" released by "delete_volume" :: held 1.541s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e372b62-5781-450c-b295-042e95a59895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:17:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-317306222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5797d7f-9fc4-4237-a1ab-32ddb1888884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff50fe3f307b45339f84202dc8f9824f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:17:06Z,use_quota=True,user_id='d506db2ed1694d87a4dca003b82e162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e03125-f427-4410-935e-98011a3e3aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e03125-f427-4410-935e-98011a3e3aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d93234-df52-4969-a9e2-0908825b99e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d93234-df52-4969-a9e2-0908825b99e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5797d7f-9fc4-4237-a1ab-32ddb1888884', 'volume_name': 'volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68e9d3c-06b9-4a60-ba1a-3fe334950568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68e9d3c-06b9-4a60-ba1a-3fe334950568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c984513-3c5b-4538-aa81-87151dd4f21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:06 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Volume c5797d7f-9fc4-4237-a1ab-32ddb1888884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884', 'volume_size': 1} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-18T10:17:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-317306222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5797d7f-9fc4-4237-a1ab-32ddb1888884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff50fe3f307b45339f84202dc8f9824f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T10:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T10:17:06Z,use_quota=True,user_id='d506db2ed1694d87a4dca003b82e162b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6569d2f-06f2-4c1b-9deb-9e94a36edfb9),volume_type_id=d6569d2f-06f2-4c1b-9deb-9e94a36edfb9)}" {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Creating volume c5797d7f-9fc4-4237-a1ab-32ddb1888884 {{(pid=83184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Selected 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d as target Quobyte volume. {{(pid=83184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 18 12:17:06 devstack cinder-volume[83184]: INFO cinder.volume.drivers.remotefs [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] casted to 10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d Sep 18 12:17:06 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 1073741824 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:06 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=171, name=volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 1073741824" returned: 0 in 0.645s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created reservations ['d2a0aeef-281b-472a-912c-8ae198c4b560', '2310846d-4529-4ab7-b6d3-d219873487c1', '0904dfd7-63cc-42b2-a62c-51e7315a2871', '9286e388-91b6-43c7-a4cf-bbc59fd43707'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884" returned: 0 in 0.328s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] <== create_volume: return (1079ms) {'provider_location': '10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'} {{(pid=83184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c984513-3c5b-4538-aa81-87151dd4f21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884', 'volume_size': 1}' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f534b209-691a-4ea0-98e8-b466d198e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 18 12:17:07 devstack cinder-volume[83184]: INFO cinder.volume.flows.manager.create_volume [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Volume volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 (c5797d7f-9fc4-4237-a1ab-32ddb1888884): created successfully Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f534b209-691a-4ea0-98e8-b466d198e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83184) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 18 12:17:07 devstack cinder-volume[83184]: DEBUG cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Flow 'volume_create_manager' (238d186f-1c07-4073-be23-081cb4d7457b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83184) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 18 12:17:07 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-c12ec712-d159-4612-ae3b-9244b70f9dfc tempest-CinderUnicodeTest-1272775023 None] Created volume successfully. Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.169s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:08 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Deleted volume successfully. Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0-delete_volume" acquired by "delete_volume" :: waited 0.198s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-a66a6274-b369-4af5-9246-0f4fb5f55a50 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-34f411dd-f69f-4086-ba8b-fa5f97b05608-delete_volume" released by "delete_volume" :: held 4.150s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:08 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:08 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-quobyte-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Creating offline snapshot 2e1e7315-1903-4991-8cdc-6a176107f17e of volume c5797d7f-9fc4-4237-a1ab-32ddb1888884 {{(pid=83184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 18 12:17:08 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0" acquired by "delete_volume" :: waited 0.041s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:09 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1c4e6d-52d3-4e40-bb2f-eb876d687670]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:09 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b486eff2-1003-4a0c-bbe4-96134980bbc5]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884" returned: 0 in 0.531s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e 1G {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0" returned: 0 in 0.733s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:09 devstack quobyte-client[83210]: The server volume:1c101dd5-04c5-41fc-89db-c25939916d9d@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c101dd5-04c5-41fc-89db-c25939916d9d, inode=172, name=volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.143), requestorAccessMask=0 Sep 18 12:17:09 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e 1G" returned: 0 in 0.388s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0" returned: 0 in 0.248s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0" released by "delete_volume" :: held 1.310s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] CMD "qemu-img rebase -u -b volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 -F qcow2 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e" returned: 0 in 0.391s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e" returned: 0 in 0.260s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Setting permissions: /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 -> 1000:1000 {{(pid=83184) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 18 12:17:10 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e" returned: 0 in 0.300s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.info" returned: 0 in 0.177s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] File path /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.info is being set with permissions: 660 {{(pid=83184) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.info {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created reservations ['76f3c779-16b7-48d0-80c5-51c4c6f27c96', 'e60d3217-aa50-426d-9845-da3fa4cd3478', '560ae813-c9b3-4acc-8eab-6d3fda6350dc', 'd3870345-8bf1-425f-bb22-856ba5f17189'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.info" returned: 0 in 0.318s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:11 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b1afaab4-bd93-43a6-845a-829cebfa921e tempest-CinderUnicodeTest-1272775023 None] Create snapshot completed successfully Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:11 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.109s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:17:12 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Deleted volume successfully. Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-bed7485c-b54a-4459-a260-c2bbdca96141-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "cinder-2e1e7315-1903-4991-8cdc-6a176107f17e-delete_snapshot" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-2e1e7315-1903-4991-8cdc-6a176107f17e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:12 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "cinder-quobyte-c5797d7f-9fc4-4237-a1ab-32ddb1888884" by "delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-bed7485c-b54a-4459-a260-c2bbdca96141-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-cd03dae9-c0eb-4f92-a59c-d5644c90e1bd tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-8aa19cc4-aae4-4df4-b963-9227c2b0a7f0-delete_volume" released by "delete_volume" :: held 3.642s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-quobyte-c5797d7f-9fc4-4237-a1ab-32ddb1888884" acquired by "delete_snapshot" :: waited 0.066s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "cinder-quobyte-2e1e7315-1903-4991-8cdc-6a176107f17e" by "_delete_snapshot" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:12 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-quobyte-bed7485c-b54a-4459-a260-c2bbdca96141" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-quobyte-2e1e7315-1903-4991-8cdc-6a176107f17e" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Deleting offline snapshot 2e1e7315-1903-4991-8cdc-6a176107f17e of volume c5797d7f-9fc4-4237-a1ab-32ddb1888884 {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] snapshot_file for this snap is: volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e {{(pid=83184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ca1f0-070c-4d38-a846-900f3890f663]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-bed7485c-b54a-4459-a260-c2bbdca96141" acquired by "delete_volume" :: waited 0.149s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[699b6c44-0e50-4064-9924-22c98ac3954b]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:12 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-bed7485c-b54a-4459-a260-c2bbdca96141 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e" returned: 0 in 0.498s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.remotefs [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c35eb-3d23-4b63-ad61-abdce7d9b94d]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-bed7485c-b54a-4459-a260-c2bbdca96141" returned: 0 in 0.540s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-bed7485c-b54a-4459-a260-c2bbdca96141 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-bed7485c-b54a-4459-a260-c2bbdca96141" returned: 0 in 0.101s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-bed7485c-b54a-4459-a260-c2bbdca96141" released by "delete_volume" :: held 0.887s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884" returned: 0 in 0.643s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:13 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e" returned: 0 in 0.309s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884.2e1e7315-1903-4991-8cdc-6a176107f17e" returned: 0 in 0.171s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-quobyte-2e1e7315-1903-4991-8cdc-6a176107f17e" released by "_delete_snapshot" :: held 1.888s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created reservations ['430e3024-79ba-43b0-a7ff-d7bb05470609', '770f0a1b-36ac-4bad-88be-23ca00daafec', '46f37210-2a7b-4b48-8624-a909a65f91c4', '2c6b8a01-42f1-4fd4-93fb-cf522c5c8682'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-quobyte-c5797d7f-9fc4-4237-a1ab-32ddb1888884" released by "delete_snapshot" :: held 2.050s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.213s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:14 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:17:14 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Deleted volume successfully. Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Created reservations ['382725b3-5325-427c-b456-052a63a34923', 'c3dd8633-a97c-405c-bb9f-63c1912a738e', '8b145efe-157c-4493-9713-d42c386dc792', '0f037dd4-31dc-4667-b9dd-45a66e7de1b8'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-9ab000e4-e086-486a-bd04-47b9534c284b tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-bed7485c-b54a-4459-a260-c2bbdca96141-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:15 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Delete snapshot completed successfully. Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-1ebacfb6-7a5a-4fc1-8daf-d9fd0bc15cb9 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-2e1e7315-1903-4991-8cdc-6a176107f17e-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-8810b804-b7e9-4f43-a326-f4fa94d4edcd-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "cinder-c5797d7f-9fc4-4237-a1ab-32ddb1888884-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-8810b804-b7e9-4f43-a326-f4fa94d4edcd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-c5797d7f-9fc4-4237-a1ab-32ddb1888884-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:15 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "cinder-quobyte-8810b804-b7e9-4f43-a326-f4fa94d4edcd" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:15 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "cinder-quobyte-c5797d7f-9fc4-4237-a1ab-32ddb1888884" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-8810b804-b7e9-4f43-a326-f4fa94d4edcd" acquired by "delete_volume" :: waited 0.023s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347e508-525e-4289-83e0-54ff7a601f16]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-quobyte-c5797d7f-9fc4-4237-a1ab-32ddb1888884" acquired by "delete_volume" :: waited 0.162s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c56fb-f27c-4a2a-872b-a4d21219eff8]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:15 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd" returned: 0 in 0.502s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-8810b804-b7e9-4f43-a326-f4fa94d4edcd" returned: 0 in 0.135s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-quobyte-8810b804-b7e9-4f43-a326-f4fa94d4edcd" released by "delete_volume" :: held 0.800s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884" returned: 0 in 0.721s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-c5797d7f-9fc4-4237-a1ab-32ddb1888884" returned: 0 in 0.239s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-quobyte-c5797d7f-9fc4-4237-a1ab-32ddb1888884" released by "delete_volume" :: held 1.195s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:16 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Created reservations ['0808e769-b3d0-4e16-b4fe-50f43a9b0400', '26c6eef0-3272-421d-9f63-489089ffa2aa', '02992a2c-2957-4be0-9f0d-b32847fb2985', 'c58277ac-2101-419b-a283-6a76f26788b5'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Created reservations ['18d29134-3d38-48ce-9618-9d2792c240af', '02316d3f-787f-4a17-ad49-34fdf94b50d0', 'b82f3261-d370-44e1-ad5d-e3ec25772244', 'bfd59bca-c2d6-4b6f-92b2-21aebb79751b'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.289s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:17:17 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Deleted volume successfully. Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-286b64e4-7349-4093-b15a-77cef3945009 tempest-CreateVolumesFromSourceVolumeTest-1081180270 None] Lock "cinder-8810b804-b7e9-4f43-a326-f4fa94d4edcd-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:17 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "cinder-a1e465c1-d68a-4c16-8f54-3e7b47035131-delete_volume" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.343s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:17:18 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Deleted volume successfully. Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-a1e465c1-d68a-4c16-8f54-3e7b47035131-delete_volume" acquired by "delete_volume" :: waited 0.238s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-0bf31a4c-3e55-435a-ba1a-6c34d4af6b27 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-c5797d7f-9fc4-4237-a1ab-32ddb1888884-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:18 devstack cinder-volume[83184]: WARNING cinder.volume.volume_utils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "cinder-quobyte-a1e465c1-d68a-4c16-8f54-3e7b47035131" by "delete_volume" {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-quobyte-a1e465c1-d68a-4c16-8f54-3e7b47035131" acquired by "delete_volume" :: waited 0.017s {{(pid=83184) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07282d2-ebbc-4341-b9ce-ca0b7e174d6c]: (4, 'qcow2') {{(pid=84522) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a1e465c1-d68a-4c16-8f54-3e7b47035131 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a1e465c1-d68a-4c16-8f54-3e7b47035131" returned: 0 in 0.484s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:18 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a1e465c1-d68a-4c16-8f54-3e7b47035131 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] CMD "rm -f /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184/volume-a1e465c1-d68a-4c16-8f54-3e7b47035131" returned: 0 in 0.110s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-quobyte-a1e465c1-d68a-4c16-8f54-3e7b47035131" released by "delete_volume" :: held 0.774s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG cinder.quota [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Created reservations ['900e2ea0-7d98-47df-a7b3-e1b279d7b5a6', 'b6cb48bb-186b-4d04-a683-5b9d893b2feb', '1ed1e35e-8bd2-4dbd-ad93-3f6352494477', '9e79e09c-0574-4a50-818e-a23fabfc78a6'] {{(pid=83184) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.124s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:19 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 18 12:17:19 devstack cinder-volume[83184]: INFO cinder.volume.manager [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Deleted volume successfully. Sep 18 12:17:20 devstack cinder-volume[83184]: DEBUG cinder.coordination [None req-b3b1ec4f-ed86-4566-86f3-bd9a26d26907 tempest-CinderUnicodeTest-1272775023 None] Lock "cinder-a1e465c1-d68a-4c16-8f54-3e7b47035131-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=83184) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 18 12:17:29 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:UPDATE=119,cinder:SELECT=75,cinder:INSERT=32,cinder:DELETE=11 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:17:29 devstack cinder-volume[83184]: DEBUG dbcounter [-] [83184] Writing DB stats cinder:SELECT=90,cinder:INSERT=33,cinder:UPDATE=137,cinder:DELETE=12 {{(pid=83184) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG oslo_service.periodic_task [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83184) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d': None} {{(pid=83184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG cinder.volume.drivers.quobyte [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Available shares ['10.10.41.181/cinder-vol-4c79e75a-3968-44a2-9b6f-967271ed375d'] {{(pid=83184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.lockutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83184) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184 {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG oslo_concurrency.processutils [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6dd37b66f2d1c51c05e4f7b995b37184" returned: 0 in 0.098s {{(pid=83184) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 18 12:17:45 devstack cinder-volume[83184]: DEBUG cinder.manager [None req-34af015f-9ee1-4b8a-9024-3f61079e03a7 None None] Notifying Schedulers of capabilities ... {{(pid=83184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}